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Preface 



The present volume consists of invited contributions by outstanding experts in 
the field of boundary problems in analysis and geometry. This subject is in the 
center of current research activities and encompasses a variety of connections and 
interactions. Despite of their differences in scope and methods, boundary problems 
constitute an essential field of common interest. The intention of this volume is to 
highlight several analytic and geometric aspects of boundary problems with special 
emphasis on their interplay. It includes surveys on classical topics presented from 
a modern perspective as well as reports on current research. 

The collection of articles in this book roughly splits into two related groups: The 
first group concerning the analysis and geometry of geometric operators and their 
index theory; the second one dealing with elliptic theory of boundary value prob- 
lems and the Shapiro-Lopatinsky condition. There is a total of nine papers. 

The paper by Bleecker and Booss-Bavnbek is devoted to classical aspects of the 
index of Dirac operators on manifolds with boundary, and gives an extensive intro- 
duction to general index theory. In particular, the Atiyah-Patodi-Singer boundary 
condition and the 77-invariant are studied in detail. 

In the second paper, Loya discusses the heat equation method for Dirac operators 
on manifolds with boundary having metrics that degenerate near the boundary. 
Generalized 77-invariants are studied as they appear as global correction terms to 
the topological index. 

Starting from the classical index problem on manifolds with boundary. Savin and 
Sternin develop a general framework for the index defect arising in the investiga- 
tion of topological and analytical indices. Index defects are considered in several 
examples. 

In the paper by Benameur, Brodzki, and Nistor, the authors study index theory 
by adopting ideas from noncommutative geometry in terms of algebras of pseudo- 
differential operators and associated homologies and cohomologies. 

Bunke and Ma introduce some aspects of index and secondary index theory. Di- 
verse K- and L-functors are considered, including a thorough discussion of their 
various interrelations, and their main properties are derived building upon the 
machinery of 77- forms and adiabatic limits. 



XI 




xii PREFACE 

The article by Schulze deals with the parametrix construction for elliptic bound- 
ary value problems that do not satisfy the Shapiro-Lopatinsky condition, as it is 
the case for the Atiyah-Patodi-Singer problem. This involves the consideration of 
projections defining subspaces of admissible boundary data, and gives rise to the 
study of Toeplitz operators. 

In the next article, Popivanov gives a survey on the tangential oblique derivative 
problem. Historically, this problem laid the ground for various developments in 
analysis that were later particularly applied to solve many geometric problems. 
The author demonstrates the use of several analytic techniques and their interplay 
for the problem at hand, emphasizing their methodical background. 

The paper by Mitrea and Nistor is concerned with the Laplace equation on a 
manifold with cylindrical ends under Dirichlet and Neumann boundary conditions. 
The authors illustrate the use of the layer potential method from harmonic analysis 
combined with pseudodifferential techniques on the boundary. 

The final paper by Nazaikinskii and Sternin generalizes concepts from elliptic 
boundary value problems to the case of surfaces of higher codimension. This in- 
cludes, in particular, the construction of a related algebra of pseudodifferential 
operators. A generalization of the Shapiro-Lopatinsky condition is considered, and 
the index problem is investigated in K-theoretical terms. 

The initiative for editing this volume emerged during the workshop “Ellipticity 
and Parabolicity in Analysis and Geometry” held at the University of Potsdam, 
Germany, in August 2001. We wish to express our gratitude to the participants 
of the workshop for many valuable discussions and for suggesting to edit this col- 
lection. We would also like to thank Professor B.-W. Schulze for his invaluable 
support and for promoting this project. Finally, we are grateful to the Deutsche 
Forschungsgemeinschaft (DFG) and the FU Research and Training Network “Geo- 
metric Analysis” for funding the workshop, and to Birkhauser Verlag for publishing 
the volume. 



Juan Gil, Thomas Krainer, and Ingo Witt. 
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Spectral invariants of operators of Dirac type 
on partitioned manifolds 

David Bleecker and Bernhelm Booss-Bavnbek 

Abstract. We review the concepts of the index of a Fredholm operator, the 
spectral flow of a curve of self-adjoint Fredholm operators, the Maslov index 
of a curve of Lagrangian subspaces in a symplectic Hilbert space, and the 
eta invariant of operators of Dirac type on closed manifolds and manifolds 
with boundary. We emphasize various (occasionally overlooked) aspects of 
rigorous definitions and explain the quite different stability properties. More- 
over, we utilize the heat equation approach in various settings and show how 
these topological and spectral invariants are mutually related in the study of 
additivity and nonadditivity properties on partitioned manifolds. 



Introduction 

For many decades now, workers in differential geometry and mathematical 
physics have been increasingly concerned with differential operators (exterior dif- 
ferentiation, connections, Laplacians, Dirac operators, etc.) associated to under- 
lying Riemannian or space-time manifolds. Of particular interest is the interplay 
between the spectral decomposition of such operators and the geometry /topology 
of the underlying manifold. This has become a large, diverse field involving index 
theory, the distribution of eigenvalues, zero sets of eigenfunctions, Green func- 
tions, heat and wave kernels, families of elliptic operators and their determinants, 
canonical sections, etc.. Moreover, Donaldson’s analysis of moduli of solutions of 
the nonlinear Yang-Mills equations and Seiberg-Witten theory have led to pro- 
found insights into the classification of four- manifolds, which were not accessible 
by techniques that are effective in higher dimensions. 

We shall touch upon many of these topics, but we focus on three invariants 
characterizing the asymmetry of the spectrum of operators of Dirac type: the index 
which gives the chiral asymmetry of the kernel or null space (i.e., the difference in 
the number of independent left and right zero modes) of a total Dirac operator; the 

2000 Mathematics Subject Classification. 53C21, 58G30. 

Key words and phrases. Determinant, Dirac operators, eta invariant, heat equation, index, 
Maslov index, partitioned manifolds, pasting formulas, spectral flow, symplectic analysis. 
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spectral flow of a curve of Dirac operators that counts the net number of eigenvalues 
moving from the negative half line over to the positive; and the eta invariant 
which describes the overall asymmetry of the spectrum of a Dirac operator. The 
three invariants appear both for Dirac operators and curves of Dirac operators 
on a closed manifold or on a smooth compact manifold with boundary subject to 
suitable boundary conditions. 

Index and spectral flow can be described in general functional analytic terms, 
namely for bounded and unbounded, closed Fredholm operators and curves of 
bounded and unbounded self-adjoint Fredholm operators. Correspondingly, sta- 
bility properties of index and spectral flow and their topological and geometric 
meaning are relatively well understood. There is, however, not an easily identifi- 
able operator class for eta invariant, and its behavior under perturbations is rather 
delicate. 

Most significant differences between the behavior of these three invariants are 
met when we address splitting properties on partitioned manifolds (with product 
metrics assumed near the partitioning hypersurface). It is well known that the 
index can be described in local terms. This is one aspect of the Atiyah-Singer 
Index Theorem. So, splitting formulas for the index are relatively easily obtainable, 
once one specifies and understands boundary and transmission conditions for the 
gluing of the parts of the underlying manifold. In this process, precise additivity 
is obtained only for a few invariants, Euler characteristic and signature, which 
actually can be characterized by cutting and pasting invariance. In general, an error 
term appears which can be expressed either by spectral flow or, equivalently, by the 
index of a boundary value problem on a cylinder over the separating hypersurface 
or, alternatively, by the index of a suitable Fredholm pair. 

Surprisingly, simple splitting formulas can be obtained also for the spectral 
flow and eta invariant. This is particularly surprising for the eta invariant where 
we only have a local formula for the first derivative. Now the integer error terms are 
expressed by the Maslov index for curves of Cauchy data spaces. These formulas re- 
late the symmetric category of self-adjoint Dirac operators over closed partitioned 
manifolds (and self-adjoint boundary value problems over compact manifolds with 
boundary) to the symplectic analysis of Lagrangian subspaces (the Cauchy data 
spaces) . 

One message of this review is, that index, spectral flow, and eta invariant, in 
spite of their quite different appearance, share various features which become most 
visible on partitioned manifolds. Roughly speaking, one reason for that is that the 
spectral flow of a path of Dirac type operators (say, on a closed manifold) with 
unitarily equivalent ends A\ = gAog~^ equals the index of the induced suspension 
operator dt -\- At on the underlying mapping torus (see [BoWo93, Theorems 17.3, 
17.17, and Proposition 25.1]). Another reason is that the integer part of the deriv- 
ative of the eta invariant along a path of Dirac operators or boundary problems 
can be expressed by the spectral flow (see, e.g., [DoWo91], [LeWo96, p. 39], and 
[KiLeOO, Section 3]). 
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We also summarize recent discussion on additivity and non- additivity of the 
zeta regularized determinant. It should be mentioned that the various splitting 
formulas all depend decisively on the well-established unique continuation property 
(UCP) for operators of Dirac type. We give a full proof of weak UCP below in 
Section 1.4. Moreover (modulo some technicalities for the computation of the index 
density form, to appear in our forthcoming book [BlBo04]), we provide proofs of 
the Atiyah-Singer and Atiyah-Patodi-Singer Index Theorems in important special 
cases using heat equation methods. That we explain concrete calculations only for 
the case of the Atiyah-Patodi-Singer (spectral - ‘‘APS”) boundary condition is 
no big loss of generality since each admissible boundary condition for an operator 
of Dirac type T> with tangential part B can be written as the APS projection of 
a perturbed operator B' (see below Lemma 2.29, following a recent result, Gerd 
Grubb [Gr02]). 

Acknowledgments. The second author wants to thank K. P. Wojciechowski 
(Indiana University - Purdue University Indianapolis) for many discussions about 
the subject (s) of this review and the Erwin Schrodinger International Institute 
for Mathematical Physics at Vienna for generous hospitality during the finalizing 
phase of this review. We both thank the referees for their corrections, thoughtful 
comments, and helpful suggestions which led to many improvements. They clearly 
went beyond the call of duty, and we are in their debt. 

1. Basic notations and results 

1.1. Index of Fredholm operators and spectral flow of curves 
of self-adjoint Fredholm operators. 

1.1.1. Notation. Let iL be a separable complex Hilbert space. First let us 
introduce some notation for various spaces of operators in H: 

C{H) := closed, densely defined operators on H, 

B{H) bounded linear operators H 
U{H) \= unitary operators H ^ H, 

JC(H) compact linear operators H ^ H, 

:= bounded Fredholm operators H 
CT{H) := closed, densely defined Fredholm operators on H. 

If no confusion is possible we will omit “(if)” and write C, B^JC, etc.. 

By etc., we denote the set of self-adjoint elements in C, B, etc.. 

1.1.2. Operators with index - Fredholm operators. The topology of the oper- 
ator spaces U{H), and is quite well understood. The key results 

are: 

(1) the Kuiper Theorem which states that U{H) is contractible; 

(2) the Atiyah-Jdnich Theorem which states that T{H) is a classifying space 
for the functor K. Explicitly, the construction of the index bundle of 
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a continuous family of bounded Fredholm operators parametrized over 
a compact topological space X yields a homomorphism of semigroups, 
namely index : [X^X] K {X) . In particular, the index is a homotopy 
invariant, and it provides a one-to-one correspondence of the connected 
components [point, X] of T with K {point) = Z. 

(3) the corresponding observation that J^^{H) consists of three connected 
components, the contractible subsets and X^^{H)- of essen- 

tially positive, respectively essentially negative, Fredholm operators, and 
the topologically nontrivial component Tl^{H) which is a classifying 
space for the functor K ~^ . In particular, the spectral flow gives an iso- 
morphism of the fundamental group tti (J^^{H)) onto the integers. 

Full proofs can be found in [BlBo04] for items 1 and 2, and in [AtSi69], 
[BoWo93], and [Ph96] for item 3. 

So much for the bounded caise. Of course, the Dirac operators of interest to 
us are not bounded in L^. On closed manifolds, however, they can be considered 
as bounded operators from the first Sobolev space into and by identifying 
these two Hilbert spaces we can consider a Dirac operator as a bounded operator 
of a Hilbert space in itself. The same philosophy can be applied to Dirac operators 
on compact manifolds with boundary when we consider the domain not as dense 
subspace in but as Hilbert space (with the graph inner product) and then 
identify. 

Strictly speaking, the concept of unbounded operator is dispensable here. How- 
ever, for varying boundary conditions it is necessary to keep the distinction and 
to follow the variation of the domain as a variation of subspaces in L^. 

Following [CorLab], we generalize the concept of Fredholm operators to the 
unbounded case. 

Definition 1.1. Let if be a complex separable Hilbert space. A linear (not 
necessarily bounded) operator F with domain Dom(F), null-space Ker(F), and 
range Im(F) is called Fredholm if the following conditions are satisfied. 

(i) Dom(F) is dense in H. 

(ii) F is closed. 

(iii) The range Im(F) of F is a closed subspace of H. 

(iv) Both dimKer(F) and codim Im(F) = dimlm(F)-^ are finite. The differ- 
ence of the dimensions is called index(F). 

So, a closed operator F is characterized as a Fredholm operator by the same 
properties as in the bounded case. Moreover, as in the bounded c^lse, F is Fredholm 
if and only if F* is Fredholm (proving the closedness of Im(F*) is delicate: see 
[CorLab, Lemma 1.4]) and (clearly) we have 

index F = dim Ker F — dim Ker F* = — index F* . 

In particular, index F = 0 in case F is self-adjoint. 
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The composition of (not necessarily bounded) Fredholm operators yields again 
a Fredholm operator. More precisely, we have the following composition rule. For 
the proof, which is considerably more involved than that in the bounded case, we 
refer to [GoKr57], [CorLab, Lemma 2.3 and Theorem 2.1]. 

Theorem 1.2 (Gohberg, Krein). If F and G are {not necessarily bounded) 
Fredholm operators then their product GF is densely defined with 

Bom{GF) = Dom(F) H F~^ Dom(G) 
and is a Fredholm operator. Moreover, 

index GF = index F + index G . 

1.1.3. Metrics on the space of closed operators. For S, T E C{H) the orthog- 
onal projections ^ 0 ( 5 ), onto the graphs of S', T in Lf 0 /f are bounded 

operators and 

7(5, T) := ||Pe(T)-Pe(s)ll 
defines a metric for C{H), the projection metric. 

It is also called the gap metric and it is (uniformly) equivalent with the metric 
given by measuring the distance between the (closed) graphs, namely 

d(0(S), 0(T)) sup d {x, 0(T)) + sup d (x, 0(S)) . 

{xe0(5):||:r|l = l} {xG 0 (T): ||o:|l = l} 

For details and the proof of the following lemma and theorem, we refer to [CorLab, 
Section 3]. 

Lemma 1.3. ForT G C{H) the orthogonal projection onto the graph of T in 
H ® H can he written {where Rt {I + T*T)“^) as 

Rt RtT* \ =f T^Rt* Rt T^Rt* \ 

-f'e(T) TRtT*) [tRt TT*Rt>) [tRt I - Rt- J ' 

Theorem 1.4 (Cordes, Labrousse). 

(a) The space B{H) of hounded operators is dense in the space C{H) of all closed 
operators in H . The topology induced hy the projection {— gap) metric on 
B{H) is equivalent to that given by the operator norm. 

(b) Let CF{H) denote the space of closed {not necessarily bounded) Fredholm op- 
erators. Then the index is constant on the connected components of CF{H) 
and yields a hijection between the integers and the connected components. 

Example 1.5. Let H he a Hilbert space with ei, 62 , . . . a complete orthonor- 
mal system (i.e., an orthonormal basis for H). Consider the multiplication operator 
Mid, given by the domain 

D Dom(Mjd) := 

and the operation 



DBu = '^CjCj 



Md(w) := ■ 
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It is a densely defined closed operator which is injective and surjective. Let 
denote the orthogonal projection of H onto the linear span of the n-th orthonor- 
mal basis element • Clearly the sequence (F^) does not converge in B{H) in 
the operator norm. However, the sequence Mid “ 2nPn of self-adjoint Fredholm 
operators converges in C{H) with the projection metric to Mid. 

This can be seen by the following argument: On the subset of self-adjoint 
(not necessarily bounded) operators in the space the projection metric is 

uniformly equivalent to the metric 7 given by 

7(^15 ^2) 11(^1 + 0 ^ — (^2+^) ^11, 

(see below Theorem 1.10). Then for := Mid — 

I (T„ + i)~^ - (Mid + I = I {-n + i)~^ e„ - (n + e„| = ^ 0. 

Remark 1.6. The results by Heinz Cordes and Jean-Philippe Labrousse may 
appear to be rather counter-intuitive. For (a), it is worth mentioning that the 
operator-norm distance and the projection metric on the set of bounded operators 
are equivalent but not uniformly equivalent since the operator norm is complete 
while the projection metric is not complete on the set of bounded operators. Ac- 
tually, this is the point of the first part of (a); see also the preceding example. 

Assertion (b) says two things: (i) that the index is a homotopy invariant, 
i.e., two Fredholm operators have the same index if they can be connected by a 
continuous curve in CP{H)\ (ii) that two Fredholm operators having the same 
index always can be connected by a continuous curve in CP{H). Note that the 
topological results are not as far reaching as for bounded Fredholm operators. 

1.1.4. Self-adjoint Fredholm operators and spectral flow. We investigate the 
topology of the subspace of self-adjoint (not necessarily bounded) Fredholm oper- 
ators. Many users of the notion of spectral flow feel that the definition and basic 
properties are too trivial to bother with. However, there are some difficulties both 
with extending the definition of spectral flow from loops to paths and from curves 
of bounded self-adjoint Fredholm operators to curves of not necessarily bounded 
self-adjoint Fredholm operators. 

To overcome the second difficulty, the usual way is to apply the Riesz trans- 
formation which yields a bijection 

71 ^ {S e I Ill'll < 1 and S ± I both injective}, where 

( 1 - 1 ) n{T) :=T{I + 

In [BoFu98] the following theorem was proved: 

Theorem 1.7. Let S be a self-adjoint operator with compact resolvent in a 
real separable Hilbert space 7i and let C be a bounded self-adjoint operator. Then 
the sum S C also has compact resolvent and is a closed Fredholm operator. We 
have 

\\n{s + c)-n{s)\\<c\\c\\, 

where the constant c does not depend on S or on C. 
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The preceding theorem is applied in the following form: 

Corollary 1.8. Curves of self-adjoint {unbounded) Fredholm operators in a 
separable real Hilbert space of the form + Ct}t€i o,re mapped into continuous 
curves in by the transformation IZ when S is a self-adjoint operator with com- 
pact resolvent and {Ct}t^i is a continuous curve of bounded self-adjoint operators. 

Remark 1.9. Define 

Ts : 8^^ ^ by Tg (C) := S -h C 

This is translation by S, mapping bounded self-adjoint operators on H into self- 
adjoint Fredholm operators in hi. On the gap topology is defined by the 

metric 

9{AuA2) := V\\Ra^ - Ra , P + \\AiRa, - A^Ra , IP , 

where Ra^ := {I F A^)~^ as before (see Cordes and Labrousse, [CorLab] and also 
Kato, [Kat]). Theorem 1.7 says that the composition 77. o 7^ is continuous. 



Rsa ^ 




Further, we can prove that the translation operator 7^ is a continuous operator 
from 8^^ onto the subspace 8^^ F S d 

The preceding arguments permit to treat continuous curves of Dirac operators 
in the same way as continuous curves of self-adjoint bounded Fredholm operators 
under the precondition that the domain is fixed and the perturbation is only by 
bounded self-adjoint operators. That precondition is satisfied when we have a 
curve of Dirac operators on a closed manifold which differ only by the underlying 
connection. It is also satisfied for curves of Dirac operators on a manifold with 
boundary as long the perturbation is bounded. In particular, this demands that 
the domain remains fixed. 

A closer look at Example 1.5 shows that the preceding argument cannot be 
generalized: The sequence of the Riesz transforms 1Z{Tn) of := Mid ~ 
does not converge, since lZ{Tn) is not a Cauchy sequence: 



||7^(T,)-7^(T,+l)|| > ||7^(7;)en-7^(Mid)en|| 



n-2n 



n 






2n 

\Zr+n^ 



as n ^ CO. 



In particular, the Riesz transformation is not continuous on the whole space 
nor on neither on the whole space of self-adjoint operators with compact 

resolvent. Other methods are needed for working with varying domains. 
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Of course, we can define a different metric in ; e.g. the metric which makes 
the Riesz transformation a homeomorphism. That approach was chosen by L. 
Nicolaescu in [NiOO]. He shows that quite a large class of naturally arising curves 
of Dirac operators with varying domain are continuous under this ‘Riesz metric’, 
as opposed to the aforementioned example. 

Here, we choose a different approach and adopt the gap metric. Note that 
continuity in the gap metric is much easier to establish than continuity in the 
Riesz metric. We follow [BoLePhOl] where the proofs can be found. A feature of 
this approach is the use of the Cayley Transform: 

Theorem 1.10. 

(a) On the gap metric is (uniformly) equivalent to the metric 7 given by 

(b) Let K : R ^ \ {1}^ X denote the Cayley transform. Then k induces 

a homeomorphism 

K : C^^(H) -^{U e U(H) \ U -I is injective } 

T ^ k{T) = {T - i){T + i)~^ . 

More precisely, the gap metric is (uniformly) equivalent to the metric 6 defined 
by ^T,,T2) = MT,)-k(T2)1 

We note some immediate consequences of the Cayley picture: 

Corollary 1.11. 

(a) With respect to the gap metric the set B^^(H) is dense in C^^(H). 

(b) For X eR the sets 

{T e C^^(H) I A ^ specT} and {T G C^^(H) \ A ^ spec^33 T} 
are open in the gap topology. 

(c) The set of (not necessarily bounded) self-adjoint Fredholm operators 

= {T e I 0 ^ speCggs T} = n~^(jrU), where 

jrU ^ {U eU \ —I ^ speCggg U} — {U eU \U + I Fredholm operator}, is open 
in 

The preceding corollary implies that the set .F®^ is dense in with respect 
to the gap metric. 

Contrary to the bounded case, we have the following somewhat surprising 
result in the unbounded case: In particular, it shows that not every gap continuous 
path in with endpoints in F*®^ can be continuously deformed into an operator 
norm continuous path in F*®^, in spite of the density of F"®^ in CJ^^. 

Theorem 1.12. 

(a) is path connected with respect to the gap metric. 
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(b) Moreover, its Cayley image 

{U ^U\U 1 Fredholm and U - I injective} — 
is dense in jrU. 



Proof, (a) Once again we look at the Cayley transform picture. Note that 
so far we have introduced three different subsets of unitary operators 

\ ^ ~ ^ injective} = 
jrU:={U eU\UFl Fredholm} , and 
:= nZ/^inj = 

Let U G Then H is the direct sum of the spectral subspaces H± of U cor- 

responding to the intervals [0,7t) and [tt, 27t], respectively, and we may decompose 
U = 0 [/_. More precisely, we have 

spec{U^) C I t e [0,7r)} and spec(f/_) C | t G [tt, 27t]} . 

Note that there is no intersection between the spectral spaces in the endpoints: if 
— 1 belongs to spec(/7), it is an isolated eigenvalue by our assumption and hence 
belongs only to spec(f/_); if 1 belongs to spec(f/), it can belong both to spec(/7-|_) 
and spec(f/_), but in any case, it does not contribute to the decomposition of U 
since, by our assumption, 1 is not an eigenvalue at all. 

By spectral deformation (“squeezing the spectrum down to and — z”) we 
contract U-^ to il^ and U- to — i/_ , where I± denotes the identity on H± . We do 
this on the upper half arc and the lower half arc, respectively, in such a way that 
1 does not become an eigenvalue under the course of the deformation: actually it 
will no longer belong to the spectrum; neither will —1 belong to the spectrum. 
That is, we have connected U and z/_|_ 0 — z/_ within n 

We distinguish two cases: If H- is finite- dimensional, we now rotate — i/_ up 
through —1 into z/_: More precisely, we consider 0 

This proves that we can connect U with 0 il- = il within k, in this 

first case. 

If i/_ is infinite- dimensional, we “dilate” — z/_ in such a way that no eigen- 
values remain. To do this, we identify with T^([0, 1]). Now multiplication by 
—i on T^([0, 1]) can be connected to multiplication by a function whose values are 
a short arc centered on —i and so that the resulting operator V- on has no 
eigenvalues. This will at no time introduce spectrum near +1 or —1. We then ro- 
tate this arc up through +1 (which keeps us in the right space) until it is centered 
on +z. Then we contract the spectrum on H- to be That is, also in this case 
we have connected our original operator U to +z7. To sum up this second case 
(see also Figure 1): 

U ~ 0 —il- ~ i/+ 0 10 ~ 0 for t G [0, 1], 

~ z7-j_ 0 — V— ~ z7_j_ 0 —[—il^) rsj iJ . 
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Figure 1. Connecting a fixed U in j^U iri} to il. 

Case I (finite rank U-) and Case II (infinite rank U-) 



To prove (b), we just decompose any V G into V = [/ 0 /i, where U G 
and Ii denotes the identity on the 1-eigenspace Hi = Ker(F — 7) of F 
with H — Ho^Hi an orthogonal decomposition. Then for e > 0,U 0e^^7i G 
approaches C/ for s ^ 0. □ 

Remark 1.13. The preceding proof shows also that the two subsets of 
= {T € er - 1 spec,,,(T) c C^}, 
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the spaces of all essentially positive, resp. all essentially negative, self-adjoint Fred- 
holm operators, are no longer open. The third of the three complementary subsets 

CTf = \ {cj^^ u cr^) 

is also not open. We do not know whether the two “trivial” components are con- 
tractible as in the bounded case nor whether the whole space is a classifying space 
for as the nontrivial component in the bounded case. Independently of Exam- 
ple 1.5, the connectedness of CJ^’^ and the disconnectedness of show that the 
Riesz map is not continuous on in the gap topology. 

In analogy to [Ph96], we can give an explicit description of the winding num- 
ber (spectral flow across —1) wind(/) of a curve / in jrU. Alternatively, it can be 
used as a definition of wind: 

Proposition 1.14. Let f : [0, 1] ^ jrU be a continuous path. 

(a) There is a partition {0 = t^ < t\ < ••• < tn = 1}, and positive real numbers 

0 < Sj < 7T, j — 1, . . . ,n, such that Ker(/(t) — = {0} for tj-i < t < 

tj . 

(b) Then 

n 

wind(/) = 

where 

k{t,ej) := E 

0<6<£j 

(c) In particular, this calculation of wind(/) is independent of the choice of the 
partition of the interval and of the choice of the barriers. 

Proof. In (a) we use the continuity of / and the fact that / (t) G j^U. (b) 
follows from the path additivity of wind, (c) is immediate from (b). □ 

The idea of a spectral flow across —1 was introduced first in [BoFu98, Sec. 1.3], 
where it was used to give a definition of the Maslov index in an infinite dimensional 
context (see also Definition 1.24 further below). 

After these explanations, the definition of spectral flow for paths in is 

straightforward: 

Definition 1.15. Let / : [0,1] ^ be a continuous path. Then the 

spectral flow SF(/) is defined by 

SF(/) := wind(/to /). 

From the properties of k and of the winding number, we infer immediately: 

Proposition 1.16. SF is path additive and homotopy invariant in the follow- 
ing sense: Let /i , /2 : [0, 1] ^ be continuous paths and let h : [0, 1] x [0, 1] ^ 
be a homotopy such that h{0,t) = fi{t), h(l,t) = f 2 {t), (^nd such that 
dimKer h(s,0), dimKer h(s, 1) are independent of s. Then SF(/i) = SF(/ 2 ). In 
particular, SF is invariant under homotopies leaving the endpoints fixed. 
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From Proposition 1.14 we get 

Proposition 1.17. For a continuous path f : [0,1] ^ our definition of 
spectral flow coincides with the definition in [Ph96j. 

Note that also the conventions coincide for 0 G spec/(0) or 0 G spec /(I). 

Corollary 1.18. For any S G with compact resolvent and any contin- 
uous path C : [0, 1] we have SF{S + C) = SF{1Z{S C)), where 1Z denotes 

the Riesz transformation of (1.1). 

Note that the curve 5 + C is in so that SF(5 + C) is defined via Cayley 

transformation, whereas the curve 1Z{S C) of the Riesz transforms is in 



Remark 1.19. The spectral flow induces a surjection of tti onto Z. 

Because Z is free, there is a right inverse of SF and a normal subgroup G of 
7Ti such that we have a split short exact sequence 

0 -> C 7Ti(CJ^^) ^ Z ^ 0. 

For now, an open question is whether G is trivial: Does the spectral flow 
distinguish the homotopy classes? That is, the question is whether each loop with 
spectral flow 0 can be contracted to a constant point, or equivalently, whether two 
continuous paths in with same endpoints and with same spectral flow can 

be deformed into each other. Or is = X x\ G the semi-direct product 

of a nontrivial factor G with Z? In that case, homotopy invariants of a curve in 
are not solely determined by the spectral flow (contrary to the folklore behind 
parts of the topology and physics literature). For now, we can only speculate about 
the existence of an additional invariant and its possible definition. For example, 
one can try to define a spectral flow at infinity. Then, continuity of the Riesz 
transformation 77. on a subclass S C would imply vanishing spectral flow at 
infinity. Non-vanishing spectral flow at infinity will typically appear with families 
of the type discussed in Example 1.5 (and after Remark 1.9). One may also expect 
it with curves of differential operators of second order. However, the results of 
[NiOO], though only obtained under quite restrictive conditions, may indicate that 
perhaps spectral flow at infinity will not be exhibited for continuous curves of 
Dirac operators. If this is true, it will also explain why the mentioned unfounded 
folklore has not yet led to clear contradictions. 

1.2. Symmetric operators and symplectic analysis. In an interview 
with Victor M. Buchstaber in the Newsletter of the European Mathematical Soci- 
ety [NoOl, p. 20], Sergej P. Novikov recalls his idea of the late 1960’s and the early 
1970’s, which were radically different of the main stream in topology at that time, 
“that the explanation of higher signatures and of other deep properties of multiply 
connected manifolds had a symplectic origin (...) In 1971 I. Gelfand went into 
my algebraic ideas: They impressed him greatly. In particular, he told me of his 
observation that the so-called von Neumann theory of self-adjoint extensions of 
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symmetric operators is simply the choice of a Lagrangian subspace in a Hilbert 
space with symplectic structure.” Closely following [BoFu98], [BoFu99], and 
[BoFuOtOl] (see also the Krein-Vishik-Birman theory summarized in [AlSiSO] 
and [LaSnTu75], for first pointing to symplectic aspects), we will elaborate on 
that thought. 

1.2.1. Symplectic Hilbert space, Fredholm Lagrangian Grassmannian, and Mas- 
lov index. We fix the following notation. Let {H, (•,*)) be a separable real Hilbert 
space with a fixed symplectic form lo, i.e., a skew-symmetric bounded bilinear form 
onHxH which is nondegenerate. We assume that uj is compatible with (-, -) in the 
sense that there is a corresponding almost complex structure J : H ^ 7i defined 
by 



(1.3) = (Jx,y) 

with = —I, V = — J, and (Jrr, Jy) = {x, y). Here V denotes the transpose of J 
with regard to the (real) inner product (x,y). Let C = C{7i) denote the set of all 
Lagrangian subspaces A of H (i.e., A = (-^A)-^, or equivalently, let A coincide with 
its annihilator A^ with respect to co). The topology of C is defined by the operator 
norm of the orthogonal projections onto the Lagrangian subspaces. 

Let Ao G £ be fixed. Then any p G C can be obtained as the image of A^ 
under a suitable unitary transformation 

= U{\^) 



(see also Figure 2a). Here we consider the real symplectic Hilbert space H as 
a complex Hilbert space via J. The group U{7i) of unitary operators of H acts 
transitively on £; i.e., the mapping 



(1.4) 



p : U{n) c, 

U ^ U{\o^) 



is surjective and defines a principal fibre bundle with the group of orthogonal 
operators (9 (Aq) as structure group. 



Example 1.20. 

(a) In finite dimensions one considers the space Ti := 0M” with the symplectic 

form 



u{{x,^),{y,T])) := - {x,7]) -h (C,y> for (x,0, {v^v) ^ 'H. 

To emphasize the finiteness of the dimension we write Lag(M^^) := C{H). For 
linear subspaces of one has 

I G Lag(R^^) <=4^ dim / = n and I Cl^ := cj-annihilator of /; 

i.e., Lagrangian subspaces are true half-spaces which are maximally isotropic 
(‘isotropic’ means / C /^). 
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Note that = R’^ 0 C with the Hermit ian product 

■= {x,y) + (^,^7) +z(c,y) -i{x,rj). 
Then every U G U(n) can be written in the form 

A 

with ^AB = ^BA, A^B = B% and A^A + B^B = /, and 



U = A + iB = 



0{n) 3 A 



A 0 

0 



- A + 02GU(n) 



gives the embedding of 0(n) in U(n). One finds Lag(R^^) = U(n)/0(n) with 
the fundamental group 

7ri(Lag(K"'^)),Ao)^Z. 

The mapping is given by the ‘Maslov index’ of loops of Lagrangian subspaces 
which can be described as an intersection index with the ‘Maslov cycle’. There 
is a rich literature on the subject, see e.g. the seminal paper [Ar67], the 
systematic review [CaLeMi94] , or the cohomological presentation [Go97]. 
(b) Let {^k]k^z\{o} a complete orthonormal system for l~i. We define an almost 
complex structure, and so by (1.3) a symplectic form, by 

jLPk := sign(A;) (p_/e . 

Then the spaces Ti- := span{(pk}k<o and := span{(^k}k>o are comple- 
mentary Lagrangian subspaces of 7i. 

In infinite dimensions, the space C is contractible due to Kuiper’s Theorem 
(see [BlBo04], Part I) and therefore topologically not interesting. Also, we need 
some restrictions to avoid infinite-dimensional intersection spaces when counting 
intersection indices. Therefore we replace by a smaller space. This problem can 
be solved, as first suggested in Swanson [Sw78], by relating symplectic functional 
analysis with the space Fred(T^) of Fredholm operators, we obtain finite dimensions 
for suitable intersection spaces and at the same time topologically highly nontrivial 
objects. 



Definition 1.21. 

(a) The space of Fredholm pairs of closed infinite-dimensional subspaces of 7i is 
defined by 

Fred^(Tf) := {(A,/i) | dim(A fl /i) < cxd, and 

A -h C closed and dim'H/{\ /a) < oo}. 

Then 

index(A, /u) := dim (A Pi /i) — dim7-^/(A-h/i) 
is called the Fredholm intersection index of (A,/i). 
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Figure 2. (i) The generation of £ = U C U{7{)] 

(ii) One curve and two Maslov cycles in TCXq = 

(b) The Fredholm- Lagrangian Grassmannian of a real symplectic Hilbert space H 
at a fixed Lagrangian subspace Aq is defined as 

rCx, := {m € £ I (m, Ao) € PreT(H)}. 

(c) The Maslov cycle of Aq in H is defined as 

where denotes the subset of Lagrangians intersecting Aq transversally; 

i.e., janXo = {0}. 

Recall the following algebraic and topological characterization of general and 
Lagrangian Fredholm pairs (see [BoPu98] and [BoPu99], inspired by [BoWo85], 
Part 2, Lemma 2.6). 

Proposition 1.22. 

(a) Let X, la E C and let denote the orthogonal projections of Ti onto X 

respectively fi. Then 

{X,fi) e Fred^(H) tta + G Fred('H) tta - tt^ G Fred(K). 

(b) The fundamental group of is and the mapping of the loops in {TL) 
onto Z is given by the Maslov index 

mas : 7ri(jr£Ao('^))) ^ 

To define the Maslov index, one needs a systematic way of counting, adding 
and subtracting the dimensions of the intersections fig H Aq of the curve {/i^} with 
the Maslov cycle Mxo- We recall from [BoFu98], inspired by [Ph96], a functional 
analytical definition for continuous curves without additional assumptions. 
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First we recall from (1.4) that any fi G can be obtained as the image 

of under a suitable unitary transformation /i = U{Xq). As noted before, the 
operator U is not uniquely determined by /j. Actually, from /3 = Aq 0C we obtain a 
complex conjugation so that we can define the transpose by the following formula 

'^U :=U^ 

and obtain a unitary operator W{fi) := which can be defined invariantly as 
the complex generator of the Lagrangian space pi relative to Aq. 

Proposition 1.23. The composed mapping W 

3 M t/ W{^l) := U'^U e (H) 
is well defined. In particular, we have 

Ker (/ + FF) = (// n Ao) (8) C = n Aq) + J {fan Aq) 

Proof. The operator / + FF is a Fredholm operator because {fi, Aq) is a 
Fredholm pair. □ 

Definition 1.24. Let H be a symplectic Hilbert space and Aq G C{H). Let 
[0, 1] 3 s /Xs G .F Cxq{7{) 

be a continuous curve. Then FFo/x is a continuous curve in jrU fiH), and the Maslov 
index can be defined by 

mas {pi, Ao) := wind (FF o fT) , 
where wind is defined as in Proposition 1.14. 

Remark 1.25. To define the Maslov (intersection) index mas({/is}, Aq), we 
count the change of the eigenvalues of FFg near —1 little by little. For example, be- 
tween s = 0 and s = s' we plot the spectrum of the complex generator FFg close to 
giTT Yu general, there will be no parametrization available of the spectrum near —1. 
For sufficiently small s', however, we can find barriers and such that 

no eigenvalues are lost through the barriers on the interval [0, s']. Then we count 
the number of eigenvalues (with multiplicity) of FFs between and at 

the right and left end of the interval [0, s'] and subtract. Repeating this procedure 
over the length of the whole s-interval [0, 1] gives the Maslov intersection index 
mas({//s}, Ao) without any assumptions about smoothness of the curve, ‘normal 
crossings’, or non- invertible endpoints. 

It is worth mentioning that the construction can be simplified for a complex sym- 
plectic Hilbert space H. Then each Lagrangian subspace of TC is the graph of a 
uniquely determined unitary operator from Ker ( J — il) to Ker ( J -h il). Moreover, 
a pair (A, pi) of Lagrangian subspaces is a Fredholm pair if and only if U~^V is Fred- 
holm, where A = 0 {U) and fi = (3 (P). We have mas {{pit} , Aq) = SF {U^^V, l) 
where the 1 indicates that the spectral flow is taken at the eigenvalue 1. 
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Remark 1.26. 

(a) By identifying 7Y = Aq C = Aq 0 Aq , we split in [BoFuOtOl] any 
U 0 U{H) into a real and imaginary part 

U = X + y/^Y 

with X,Y : Ao — » Ao . Let denote the subspace of unitary operators 

which have a Fredholm operator as real part. This is the total space of a 
principal fibre bundle over the Fredholm Lagrangian Grassmannian as 

base space and with the orthogonal group (9(Ao) as structure group. The 
projection is given by the restriction of the trivial bundle p \ UiTi) C oi 
a.4). This bundle 

may be considered as the infinite-dimensional generalization of the familiar 
bundle U(n) ^ Lag(R^^) for finite n and provides an alternative proof of the 
homotopy type of . 

(b) The Maslov index for curves depends on the specified Maslov cycle A^Aq* If 

is worth emphasizing that two equivalent Lagrangian subspaces Aq and Aq 
(i.e., dimAo/(Ao H Aq) < +oo) always define the same Fredholm Lagrangian 
Grassmannian TCxq = ^^Xq define different Maslov cycles Mxq ^ 

M-Xq ’ induced Maslov indices may also become different; in general, 

(1-5) mas({p3}se[o,i],Ao) -mas({/u,,}^e[o,i|,Ao) /O 

(see [BoFu99], Proposition 3.1 and Section 5). However, if the curve is a loop, 
then the Maslov index does not depend on the choice of the Maslov cycle. From 
this property it follows that the difference in (1.5), beyond the dependence on 
Aq and Aq, depends only on the initial and end points of the path {ps} and may 
be considered as the infinite-dimensional generalization crubr{po, ML Aq, Aq) of 
the Hormander index. It plays a part as the transition function of the universal 
covering of the Fredholm Lagrangian Grassmannian (see also Figure 2b). 

1.2.2. Symmetric operators and symplectic analysis. Let H he a. real separable 
Hilbert space and A an (unbounded) closed symmetric operator defined on the 
domain Dmin which is supposed to be dense in H. Let A* denote its adjoint 
operator with domain Dmax* We have that A*\jj^.^ = A and that A* is the maximal 
closed extension of A in H. Note that Dmax is a Hilbert space with the graph scalar 
product 

{x, y)g ■■= {x, y) + {A*x, A*y ) , 

and Dmin is a closed subspace of this Dmax since A is closed (each sequence in 
Dmin which is Cauchy relative to the graph norm defines a sequence in the graph 
0 (A) which is Cauchy relative to the simple norm m H x H). 
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We form the space j3 of natural boundary values with the natural trace map 7 
in the following way: 

-^max ^ -^max/-^min P 

X I > 7 (^) “ [^] •“ ^ “1“ -^min* 

The space (3 becomes a symplectic Hilbert space with the induced scalar product 
and the symplectic form given by Green’s form 

^ ( W > [y]) := y) - (x, A*y) for [x] , [y] € p. 

We define the natural Cauchy data space A 7(KerA*). It is a Lagrangian 
subspace of (3 under the assumption that A admits at least one self-adjoint Fred- 
holm extension Ad- Actually, we shall assume that A has a self-adjoint extension 
Ad with compact resolvent. Then (A, 7 {D)) is a Fredholm pair of subspaces of j3\ 
i.e., A e J^C^{D) iP)’ 

We consider a continuous curve in the space of bounded self-adjoint 

operators on H. We assume that the operators A* -\-Cs—r have no ‘inner solutions’; 
i.e., they satisfy the weak inner unique continuation property (UCP) 

(1.6) Ker (A* + C, - r) n = {0} 

for s G [0, 1] and |r| < eq with £0 > 0. For a discussion of UCP see Section 1.4 
below. 

Clearly, the domains Umax and Dmin are unchanged by the perturbation Cg 
for any s. So, f3 does not depend on the parameter s. Moreover, the symplectic 
form LJ is invariantly defined on j3 and so also independent of s. It follows (see 
[BoFu98, Theorem 3.9]) that the curve {Ag '.= 7 (Ker (A* + Cg))} is continuous 
in TC^(^d) iP)- 

We summarize the basic findings: 

Proposition 1.27. 

(a) Assume that there exists a self-adjoint Fredholm extension Ad of A with do- 
main D. Then the Cauchy data space A (A) is a closed Lagrangian subspace of 
j3 and belongs to the Fredholm Lagrangian Grassmannian J^C^(^d) {f3)- 

(b) For arbitrary domains D with Dmin C D C Umax ond 7(H) Lagrangian, the 
extension Ad -= Amax|D 'Is self-adjoint It becomes a Fredholm operator, if and 
only if the pair (7(11), A(A)) of Lagrangian subspaces of P becomes a Fredholm 
pair. 

(c) Let {Ct}t^[o,i] ^0 a continuous family {with respect to the operator norm) of 
bounded self-adjoint operators. Assume the weak inner UCP for all operators 
A* -\-Ct . Then the spaces 7(Ker(A* +Ct, 0)) of Cauchy data vary continuously 
in p. 

Given this, the family {Ad F Cg) can be considered at the same time in the 
spectral theory of self-adjoint Fredholm operators, defining a spectral fiow, and 
in the symplectic category, defining a Maslov index. Under the preceding assump- 
tions, the main result obtainable at that level is the following general spectral 
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flow formula (proved in [BoFu98, Theorem 5.1] and inviting to generalizations 
for varying domains Ds instead of a fixed domain D)\ 

Theorem 1.28. Let A jj be a self-adjoint extension of A with compact resolvent 
and let {Ad he a family satisfying the weak inner UCP assumption. 

Let As denote the Cauchy data space ^ (Ker {A* + Cg)) of A* Cg. Then 

SF {Ad + mas ({Ag} , 7 (D )) . 



1.3. Operators of Dirac type and their ellipticity. There are different 
notions of operators of Dirac type. We shall not discuss the original hyperbolic 
Dirac operator (in the Minkowski metric), but restrict ourselves to the elliptic 
case related to Riemannian metrics. 

Recall that, if (M,g) is a compact smooth Riemannian manifold (with or 
without boundary) with dimM = m, we denote by €i{M) = {€i{TMx, gx)}x^M 
the bundle of Clifford algebras of the tangent spaces. For S ^ M, 3 . smooth 
complex vector bundle of Clifford modules, the Clifford multiplication is a bundle 
map c : d{M) Hom(S', 5) which yields a representation c : (t[{TMx^ gx) 
}iomc{Sx^ Sx) in each fiber. We may assume that the bundle S is equipped with 
a Hermitian metric which makes the Clifford multiplication skew-symmetric 

{c{v)s,s') = ~{s,c{v)s') for v e TMx and s e Sx- 

We note that it is not necessary to assume that (M^g) admits a spin structure 
in order that 0(M) and S exist. Indeed, one special case is obtained by taking 
5 = A* (TM) and letting c be the extension of c {v) (a) = v A a — vua for v E 
TMx C Ci{TMx^gx) and o E A* {TMx): where “l” denotes the interior product 
(i.e., the dual of the exterior product A). The extension is guaranteed by the fact 
that c (u)^ = —gx {v, v) I. However, we do need a spin structure in the case where 
5 is a bundle of spinors. 

Any choice of a smooth connection 



V : C^(M; S) C^(M; T*M O S) 



defines an operator of Dirac type V coV under the Riemannian identification 
of the bundles TM and T*M. In local coordinates we have V 
for any orthonormal base {ei, . . . , 6 ^^} of TMx- Actually, we may choose a local 
frame in such a way that 



Ve = h zero order terms 

dxj 

for all 1 < j < m. So, locally, we have 



(1.7) 



T> 



E m / N 0 



+ zero order terms. 



It follows at once that the principal symbol cri{'D){x,^) is given by Clifford mul- 
tiplication with so that any operator of Dirac type is elliptic with symmetric 
principal symbol. If the connection V is compatible with Clifford multiplication (i.e. 
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Vc = 0), then the operator T> itself becomes symmetric. We shall, however, ad- 
mit incompatible metrics. Moreover, the Dirac Laplacian has principal symbol 
given by scalar multiplication by ||^|p using the Riemannian metric. 
So, the principal symbol of T>‘^ is a real multiple of the identity, and is ellip- 
tic. In the special case above where S = A* (TM) and we identify A* (TM) with 
A* {T*M) by means of the metric g, V becomes d-\-6 : (M, C) — > Q* (M, C) and 

— dS Sd is the Hodge Laplacian on the space ft* (M, C) of complex- valued 
forms on M. 

On a closed manifold M, a key result for any operator V of Dirac type (actu- 
ally, for any linear elliptic operator of first order) is the a priori estimate ( Carding ’s 
inequality) 

(1.8) IIV’lli < C (||27V>|lo + llV-llo) for all i; e (M; S) . 

Here || • ||q denotes the norm and (M; S) denotes the first Sobolev space 
with the norm || • H^. Note that the same symbol T> is used for the original operator 
(defined on smooth sections) and its closed extension with domain (M; S). 
Combined with the simple continuity relation ||D'0||o < C' W'lplh, inequality (1.8) 
shows that the first Sobolev norm || • ||^ and the graph norm coincide on (M; S). 

1.4. Weak unique continuation property. A linear or non-linear opera- 
tor acting on functions or sections of a bundle over a compact or non-compact 
manifold M has the weak Unique Continuation Property (UCP) if any solution xf) 
of the equation — 0 has the following property: If xp vanishes on a nonempty 
open subset of M, then it vanishes on the whole connected component of M 
containing ft. Note that weak inner UCP, as defined in (1.6), follows from weak 
UCP, but not vice versa. 

There is also a notion of strong UCP^ where, instead of assuming that a solution 
xp vanishes on an open subset, one assumes only that xp vanishes ‘of high order’ 
at a point. The concepts of weak and strong UCP extend a fundamental property 
of analytic functions to some elliptic equations other than the Cauchy- Riemann 
equation. 

Up to now, (almost) all work on UCP goes back to two seminal papers [Ca33], 
[Ca39] by Torsten Carleman, establishing an inequality of Carleman type (see our 
inequality 1.13 below). In this approach, the difference between weak and strong 
UCP and the possible presence of more delicate nonlinear perturbations are related 
to different choices of the weight function in the inequality, and to whether 
estimates suffice or W and estimates are required. 

The weak UCP is one of the basic properties of an operator of Dirac type V. 
Contrary to common belief, UCP is not a general fact of life for elliptic operators. 
See [P161] where counter-examples are given with smooth coefficients. Lack of 
UCP invalidates the continuity of the Cauchy data spaces and of the Calderon 
projection (Proposition 1.27c and Theorem 2.28b) and of the main continuity 
lemma (Lemma 2.27). It corrupts the invertible double construction (Section 2.3.4) 
and threatens Bojarski type theorems (like Proposition 2.33 and Theorem 2.37). 
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For partitioned manifolds M = Mi M 2 (see Section 2.3), it guarantees that 
there are no ghost solutions of = 0; that is, there are no solutions which 
vanish on Mi and have nontrivial support in the interior of M 2 . This property 
is also called UCP from open subsets or across any hypersurface. For Euclidean 
(classical) Dirac operators (i.e., Dirac operators on with constant coefficients 
and without perturbation) , the property follows by squaring directly from the well- 
established UCP for the classical (constant coefficients and no potential) Laplacian. 

From [BoWo93, Chapter 8] we recall a very simple proof of the weak UCP 
for operators of Dirac type, inspired by [Ni73, Sections 6-7, in particular the 
proof of inequality (7.11)] and [Tr80, Section II. 3]. We refer to [BooOO] for a 
further slight simplification and a broader perspective, and to [BoMaWa02] for 
perturbed equations. 

The proof does not use advanced arguments of the Aronszajn/Cordes type (see 
[Ar57] and [Co56]) regarding the diagonal and real form of the principal symbol 
of the Dirac Laplacian nor any other reduction to operators of second order (like 
[We82] ) , but only the following product property of Dirac type operators (besides 
Carding ’s inequality). 

Lemma 1.29. Let Ti he a closed hypersurface of M with orientable normal 
bundle. Let u denote a normal variable with fixed orientation such that a bicollar 
neighborhood N of is parameterized by [— s, -fe] x S. Then any operator of Dirac 
type can be rewritten in the form 

(1.9) V\n = c{du) (A + + cfj , 

where is a self-adjoint elliptic operator on the parallel hypersurface T^u, and 

Cu ■ ^ is CL skew- symmetric operator of order zero, actually a skew- 

symmetric bundle homomorphism. 

Proof. Let (u,y) denote the coordinates in a tubular neighborhood of E. 
Locally, we have ^ = (yi, . . . , ym-i)- Let ci, . . . , Cm-i denote Clifford multipli- 
cation by the unit tangent vectors in normal, respectively tangential, directions. 
By (1.7), we have 



m—i 

^ O 0 

V — Cut : — H / CkT 1" zero order terms 

n'li n'lit. 






Bu —CuCkT ^ zero order terms. 



We shall call Bu the tangential operator component of the operator A. Clearly it 
is an elliptic differential operator of first order over E^^. From the skew-hermicity 
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of Cu and c/e, we have 



'^dyk^ V dy^ > 

d . 

= — Cfc Q,u~F{ 1- zero order terms 

oyk 

d 

= CuCk t: ^ zero order terms. 

oyk 

So, 

= Bu-\- zero order terms. 

Hence, the principal symbol of Bu is self-adjoint. Then the assertion of the lemma 
is proved by setting 



( 1 . 10 ) 



+ and C, := 1 (B, - . 



□ 



Remark 1.30. 

(a) It is worth mentioning that the product form (1.9) is invariant under pertur- 
bation by a bundle homomorphism. More precisely: Let D be an operator on 
M which can be written in the form (1.9) close to any closed hypersurface 
E, with Bu and Cu as explained in the preceding lemma. Let R be a bundle 
homomorphism. Then 

(5) + R) |at — c(du) T + Ct^ + c[du)S\N 

withT|iv :=c{du)*R\N- Splitting T = ^(T+T*)-h |(T — T*) into a symmetric 
and a skew-symmetric part and adding these parts to Bu and Cu , respectively, 
yields the desired form of {T) + R) \n- 

(b) For operators of Dirac type, it is well known that a perturbation by a bundle 
homomorphism is equivalent to modifying the underlying connection of the op- 
erator. This gives an alternative argument for the invariance of the form (1.9) 
for operators of Dirac type under perturbation by a bundle homomorphism. 

(c) By the preceding arguments (a), respectively (b), establishing weak UCP for 
sections belonging to the kernel of a Dirac type operator, respectively an op- 
erator which can be written in the form (1.9), implies weak UCP for all eigen- 
sections. Warning: For general linear elliptic differential operators, weak UCP 
for “zero- modes” does not imply weak UCP for all eigensections. 

To prove the weak UCP, in combination with the preceding lemma, the stan- 
dard lines of the UCP literature can be radically simplified, namely with regard to 
the weight functions and the integration order of estimates. These simplifications 
make it also very easy to generalize the weak UCP to the perturbed case. 

We replace the equation V'lp = 0 by 

( 1 . 11 ) V^:=V'iP + ^aW = 0, 
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where is an admissible perturbation, in the following sense. 

Definition 1.31. A perturbation is admissible if it satisfies the following 
estimate: 

(1.12) I^aWIxI < P('0,x)|V^(x)| for X e M, 

for a real- valued function P('0, •) which is locally bounded on M for each fixed 



Example 1.32. Some typical examples of perturbations satisfying the admis- 
sibility condition of Definition 1.31 are: 

1. Consider a nonlinear perturbation 



where is a (bounded) function which depends continuously on '0(x), 

for instance, for a fixed (bounded) spinor section a{x) we can take 

w(^(a;)) := (ip{x),a{x)) 



with (•, •) denoting the Hermitian product in the fiber of the spinor bundle over 
the base point x G M. This satisfies (1.12). 

2. Another interesting example is provided by (linear) nonlocal perturbations with 



UJ 




/c(x, z)il;{z)dz 



with suitable integration domain and integrability of the kernel k. These also 
satisfy (1.12). 



3. Clearly, an unbounded perturbation may be both nonlinear and global at the 
same time. This will, in fact, be the case in our main application. In all these cases 
the only requirement is the estimate (1.12) with bounded o;('0(-)). 



We now show that (admissible) perturbed Dirac operators always satisfy the 
weak Unique Continuation Property. In particular, we show that this is true for 
unperturbed Dirac operators. 



Theorem 1.33. Let V be an operator of Dirac type and ^a admissible 
perturbation. Then any solution -0 of the perturbed equation (1.11) vanishes iden- 
tically on any connected component of the underlying manifold M if it vanishes 
on a nonempty open subset of the connected component. 



Proof. Without loss of generality, we assume that M is connected. Let be a 
solution of the perturbed (or, in particular) unperturbed equation which vanishes 
on an open, nonempty set D. First we localize and convexify the situation and 
we introduce spherical coordinates (see Figure 3). Without loss of generality we 
may assume that O is maximal, namely the union of all open subsets on which 
vanishes; i.e., D = M\ supp 'if. 

Since M is connected, to prove that Q = M it suffices to show that Lt is closed 
(i.e., D = Q). If n / n, then let yo G dCl := \ 17, and let B be an open, normal 
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Figure 3. Local specification for the Carleman estimate 

coordinate ball about . Let p G 0 D J? and let Xq G supp -0 be a point of the 
non-empty, compact set B\Q = B H supp 'll; which is closest to p. Let 

r := d (p, xo) = nun d{p,x). 

xGB\n 

For z ^ B, let u (z) := d {p, z) — rbe a, “radial coordinate”. Note that u = 0 defines 
a sphere, say Sp^o, of radius r about xq. We have larger hyperspheres Sp^u C M 
for 0 < u < T with T > 0 sufficiently small. In such a way we have parameterized 
an annular region Nt := {«5p,u}t^G[o,T] around p of width T and inner radius r, 
ranging from the hypersphere <Sp^o which is contained in to the hypersphere 
<Sp,T- Note that Nt contains some points where 0^0, for otherwise xq G Q. Let y 
denote a variable point in <Sp,o and note that points in Nt may be identified with 
(ix,p) G [0,T] X Sp^Q. Next, we replace the solution 0 |A^t by a cutoff 

v{u,y) := (f{u)xp{u,y) 

with a smooth bump function (p with ip{u) = 1 for w < 0.8 T and <p(m) = 0 for 
u > 0.9 T. Then suppx is contained in Nt . More precisely, it is contained in 
the annular region Nq. 9 t • Now our proof goes in two steps: first we establish a 
Carleman inequality for any spinor section v in the domain of V which satisfies 
supp(x) C Nt> More precisely, we are going to show that for T sufficiently small 
there exists a constant C, such that 

(1.13) r[ [ \v{u,y)\^dydu 

J n=0 J Sp^u 

< C / f \Vv{u,y)\^ dy du 

J u=0 JSp^u 
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holds for any real R sufficiently large. In the second step we apply (1.13) to our 
cutoff section v and conclude that then ^ is equal 0 on Nj ' /2 • 

Step 1. First consider a few technical points. The Dirac operator T> has the 
form G{u){du-\-Bu) on the annular region [0, T]xSp^o, and it is obvious that we may 
consider the operator {du + Bu) instead of V. Moreover, we have by Lemma 1.29 
that Bu = Bu~\-Cu with a self-adjoint elliptic differential operator Bu and an anti- 
symmetric operator Cu of order zero, both on Sp^u- Note that the metric structures 
depend on the normal variable u. 

Now make the substitution v =: which replaces (1.13) by 



(1.14) r[ [ \vq{u,v)\^ dydu 

Jo J Sp^u 

I I 1 ^ + dydu. 



< C 



We denote the integral on the left-hand side by Jq and the integral on the right- 
hand side by Ji. Now we prove (1.14). Decompose — — \- Bu + R{T — u) into its 
symmetric part Bu + R{T — u) and anti-symmetric part du Cu> This gives 



Ji 



dvQ 2 

-h BuVq -h R{T - u)vq dy du 



fl 

Jo J «Sp 

J J J J \{Bu + R{T - u)) vq\^ dy du 



n dv 

+ CuVq,BuVo + R{T - m)uo) dydu. 



Integrate by parts and use the identity 5ft (/,P/) = | (/, {P + P*)f) in order to 
investigate the last and critical term which will be denoted by J2. This yields 
(where we drop domains of integration) 

J 2 = 25ft jj + CuVq, BuVq + R{T - m)«o) dydu 

= 25ft JJ BuVq + R{T - m)uo) dydu + 25ft JJ {CuVo, B^vo) dydu 

~ II (^0’ }*'o) JJ {vo,CuBuV())dydu 
-2 JJ (^vo,-^^ Vo + Rvo'^ dydu + JJ {vo,[Bu,Cu]vo) dydu 

= 2i? y ||wo|loC^M + Jj(vo,-2-~vo + [Bu,Cu]vo'jdydu = 2RJo + J3, 

where || ■llm denotes the m-th Sobolev norm on E\sp ^ and J3 requires a careful 
analysis. It follows from the preceding decompositions of J\ and J2 that the proof 
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< 



< 



of (1.14) will be completed with C = \ when J3 > 0. If J3 < 0 and C = ^, it 
suffices to show that 

(1.15) I J3I hoWldu + £ ||(5„ + R{T - M))«of du 

Since the operators Bu are elliptic of order 1, Garding’s inequality (1.8) yields 

||/||i<c(||/||o + ||5„/||o) 

for any section / of £* on Sp^u (and 0 < < T). Then, also using the fact that 

—2^^ + [Bu, Cu\ is a first-order differential operator on E\Sp^u, we obtain 

\M< [ \\vo\\o\\-‘^^vo + [B^,,Cu]vo\\ du<Ci[ ||i;o||o ||wo||i 
Jo Jo 

Cic / llvollo (||5«vo||o + llvollo) du 
Jo 

Cic f llwollo {||(s„ + R{T - u))vollo + {R{T -u) + l)||vol|o} du 
Jo 

<cic(RT + l)j \\vo\\ldu + cic f ||(B„ + i?(T - m))vo||o ||wo||orf«. 

Jo Jo 

The integrand of the second summand can be estimated by 
\\{Bu + R{T-u))vo\\o 

(1.16) ^ 

1 f J 
■Cl 

due to the inequality ab <i(a^ +6^). By inserting (1.16) in the preceding inequality 
for I J3I, we obtain 

|.^3l < Cic(i?T+ 1) / llvollodw 
Jo 

pT 

+ Cic (^i|^||(S„ + i2(T-M))wollo + cic||vo||^|) du 

= Cic{RT + l)f \\vo\\ldu + CiC f \cxc\\vQ\\ldu 
Jo Jo 

+ (i||(5„ + J?(T-w))vo||o) rfw 

= / ^ \\{Bu + R{T - u))vo\\l du + cic {{RT + 1) + ^ cic) f ||wo||o'^w 
Jo Jo 



(v^ll^ollo) 

< \{f-jm + RiT-u))voWl + cicl|i;o||2} 



= i/ \\{Bu + R{T-u))vo\\l du 
Jo 



Rc\C I T + 



cic + 2 

2R 



llvollodM. 
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So (1.15) holds for T and ^ sufficiently small, and we then have the Carleman 
inequality (1.13) for C = 

Step 2. To begin with, we have 

(1.17) [ f \ip{u,y)f dydu 

Jo J Sp , u 

< [ [ \{<pij;){u,y)\'^dydu. 

Jo J Sp^u 

We apply our Carleman type inequality (1.13): 

(1.18) I ■= [ [ \{(pilj){u,y)\'^dydu 

Jo J Sp^xi 

i / |I>(9?V’)(w,j/)l^d2/dw. 

Jo JSp,u 

Assuming that -0 is a solution of the perturbed equation V'lJj + ^a(' 0) = 0, we get 
V{(p'ip) = (pDip + c{du)(p''ip = —(p^aW + c{du)(p'ip. 

Using this in (1.18) and noting that (a T 6)^ < 2 (a^ + 5^), yields 

I<^[ f {\(fi{u)^A{'<P)iu,y)\'^ + \c{du)<fi'{u)'ip{u,y)\'^) dydu. 

Jo J Sp ^ u 

Now we exploit our assumption 

(1.19) \^aW{x)\ < P{'iIj,x)\'iI;{x)\ for a: G M, 
about the perturbation with locally bounded P('0, •), say 

|P('0, (7i,y))| < Co := max|P('0,x)| for all y e Sp^u, u G [0,T], 

x^K 

where A is a suitable compact set. We obtain at once 

_ 2C^) I ^ 2Q [ f \c{du)(p'{u)tp{u,y)\'^ dydu 

Jo J Sp^u 

[ [ \c{du)cp'{u)'ip{u,y)\‘^ dy du. 

Jo JSp,u 

Here we use that (p\u) = 0 for 0 < n < 0.8T so that we can estimate the expo- 
nential and pull it in front of the integral. Using (1.17), 




\'ip{u,y)f dydu<e 



< 



( 



2C 

R-2CCo 




A. 

25 




p,n 



\c{du)(p'{u)^lJ{u,y)\‘^ dy du. 
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As R cxD, we get 



T 

I I \-tp{u,y)f dydu = 0 
Jo JSp,„ 



which contradicts xq G supp'?/;. 



□ 



2. The index of elliptic operators on partitioned manifolds 

2.1. Examples and the Hellwig-Vekua index theorem. 

We begin with some elementary examples. 



Example 2.1. Consider the (trivially elliptic) ordinary differential operator 
on the unit interval I = [0, 1] defined by 

P : C^{I) X C^{I) C^{I) X 

(/, 5 ) 

with the boundary conditions C^{I) x C^{I) C^{dl) = C x C given by 

(i) Ri ■ if,9) ^ if - 9 ) \di, 

(ii) R2--if,9)'-*f\ai, 

(iii) R3-{f^9)'-^if + 9')\ai, 



where dl := {0, 1}. We determine the index of the operators 

{P,R^) : C^{I) X C^{I) C^{I) X C^{I) X C^{dl). 

for i = 1,2,3. Clearly, dim Kev{P,Ri) = 1. To determine the cokernel, one writes 
P{f,g) = {F,G) and Ri{f,g) = h, with F,G e G^{I) and h = {ho, hi) G C x C 
obtaining, 

f{t)= f F{T)dT + Cl, g{t)^~ [ G{T)dT + C2 

Jo Jo 

and two more equations for the boundary condition. The dimension of Coker (P, Ri) 
is then the number of linearly independent conditions on P, G, and h which must 
be imposed in order to eliminate the constants of integration. For each i G {1, 2, 3}, 



condition. 


namely. 












F 


F 






ho 


= hi- 


/ F{r)dr — 


/ G{T)dT\ 


(z. 


= 1) 






Jo 

F 


Jo 






ho 


= hi- 


/ F{T)dr; 
Jo 




{i = 


.2) 


ho 


= hi- 


( F{r)dr — 
Jo 


G(0) + G(1). 


{i = 


= 3) 



So, the index vanishes in all three cases. 
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For a more comprehensive treatment of the existence and uniqueness of bound- 
ary value problems for ordinary differential equations (including systems), we refer 
to [CodLev] and [Har64, p. 322-403]. 

We now consider the Laplace operator A d‘^ jdx^ + jdy^ ^ as a linear 
elliptic differential operator from C^{X) to where X is the unit disk 

{z = X + iy \ \z\ <1} (Z C, so dX = {z e C \ \z\ = 1}. 

Example 2.2. For the Dirichlet boundary condition 

R : C^{X) C^{dX) with R{u) = u\dx, 

we show that 



(a) Ker(A,i?) = {0} and (b) Im(A,i^)-*~ = {0}, 

where ± is orthogonal complement in L^{X) x L^^idX)} In particular, it follows 
that index( A, i?) = 0. 

For (a): Ker{A,R) consists of functions of the form u + iv, where u and v 
are real-valued. Since the coefficients of the operators A and R are real, we may 
assume u = 0 without loss of generality. Thus, consider a real solution u with 
Au = 0 in A and u = 0 on dX, Then (where Vu := (ux^Uy) := (|^, |^)) 

(2.1) 0 = — / uAudxdy— / \Vu^ dxdy^ 

Jx Jx 

whence Vn — 0. Thus, u is constant, and indeed zero since u = 0 on dX. The 
trick lies in the equality (2.1), which follows from Stokes’ formula, namely f^du — 
where cj is a 1-form. Indeed, setting u; := u A ^du, where * is the Hodge 
star operator (*du = * {uxdx -\- Uydy) \= Uxdy — Uydx)^ we obtain 

duj = du A ^du u Ad^ du = | Vu|^ dx A dy ^ {uAu) dx A dy. 



Using Stokes’ formula and u\qx = 0, we have 

/ \Xu\^ dxdy / (uAu) dxdy = duj= lj= u A = 0. 

Jx Jx Jx Jdx Jdx 

From this and Au = 0, we conclude that Vu = 0 and u is constant. 

For (b): Choose L c {X) and I G {dX) with (L,/) orthogonal to 

Im(A,7?), whence (relative to the usual meaisures on X and dX) 



(2.2) 



Jx JdX 



ul = 0 for all u G C^(X). 



^Here, consider that the intersection of the orthogonal complement of the range lm{A,R) 
relative to the usual inner product in L“^(X) x L‘^(dX) with the space x C^{dX) is 

isomorphic to Coker(A, R). This is true, since it turns out that the image of the natural Sobolev 
extension of (A, R) is closed in the L^-norm, and its L^-orthogonal complement is contained in 
C^{X) X C^{dX). 
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Using a 2-fold integration by parts (in the exterior calculus), we obtain 

[ uAL- [ {Au)L= [ {u{d^dL)~d{^du)L) 

^2 3^ dx Jx 

= / (u * dL — L * du) . 

Jdx 

First we consider u with support supp(u) := the closure of {z ^ X \ u{z) / 0}, 
contained in the interior of X. Then 

I uAL = j {Au) L = — I n/ = 0, 

Jx Jx JdX 

and so AL — 0. Now for u G C°^{X) we apply (2.2) and (2.3) to deduce that 

/ ul = — (Au) L = / (u*dL — L* du) 

Jdx Jx Jdx 

= / {u{xLa: yLy) - L{xUx yUy)) . 

JdX 

Thus, I = xLx + yLy and L\dx = 0, and we finally apply (a). Details can be found 
in [Ho63, p. 264]. 



The preceding result index(A,i?) = 0 (for Ru = u\dx) can also be obtained 
by proving the symmetry of A and that the extension on the domain defined 
by Ru = 0 is a self-adjoint Fredholm extension. 



We now consider a vector field : dX C on the boundary dX — 
{z ^ C \ \z\ = 1}. For u G C°^{X), z G dX, and u{z) — a{z) -h i(3{z), the “direc- 
tional derivative” of the function u relative to u at the point 2 : is 



du 



/ N r ^du , . .du . . 

(z) :=a{z)—{z) + (3{z)~{z). 



From the standpoint of differential geometry it is better, either to denote the vector 
field by ^ or to write the directional derivative as simply as u [u] (z ) , since ^ 
and ^ can be regarded as vector fields. The pair (A, ^) defines a linear operator 



(a, : C°°{X) ^ C°°(X) © C°°(ax) given by 

du\ 



Au 



Theorem 2.3 (I. N. Vekua 1952). For p G Z and ^{z) := z^ , we have that 
(Al;) is an operator with finite- dimensional kernel and cokernel, and 

d 

index (a,—) =2(1 -p). 



Remark 2.4. The theorem of Vekua remains true, if we replace z^ by any 
nonvanishing “vector field” u : dX C\ {0} with “winding number” p. 
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Figure 5. Another vector field v with winding number 2 



Moreover, in place of the disk, we can take X to be any simply-connected 
domain in C with a “smooth” boundary dX. The reason is the homotopy invariance 
of the index. 

Remark 2.5. In the theory of Riemann surfaces (e.g., in the Riemann-Roch 
Theorem), one also encounters the number 2(1 — p) as the Euler characteristic of 
a closed surface of genus p. This is no accident, but rather it is connected with the 
relation between elliptic boundary value problems and elliptic operators on closed 
manifolds. Specifically, there is a relation between the index of (A, and the 
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index of the Cauchy-Riemann operator for complex line bundles over 5^ = (C) 

with Chern number 1 — p (see Example 2.19 for a start). 



Remark 2.6. Motivated by the method of replacing a differential equation by 
difference equations, David Hilbert and Richard Courant expected “linear prob- 
lems of mathematical physics which are correctly posed to behave like a system of 
N linear algebraic equations in N unknowns (...) If for a correctly posed problem 
in linear differential equations the corresponding homogeneous problem possesses 
only the trivial solution zero, then a uniquely determined solution of the general 
inhomogeneous system exists. However, if the homogeneous problem has a nontriv- 
ial solution, the solvability of the inhomogeneous system requires the fulfillment of 
certain additional conditions.” This is the “heuristic principle” which Hilbert and 
Courant saw in the Fredholm Alternative [CoHi]. Gunter Hellwig [He52] (nicely 
explained in [Ha52]) in the real setting and Ilya Nestorovich Vekua [Ve56] in 
complex setting disproved it with their independently found example where the 
principle fails for p ^ 1. 

We remark that in addition to these “oblique- angle” boundary value problems, 
“coupled” oscillation equations, as well as restrictions of boundary value prob- 
lems, even with vanishing index, to suitable half-spaces, furnish further more or 
less elementary examples for index 7^ 0. The simplest example of a system of first 
order differential operators on the disc is provided in Example 2.7 below. A world 
of more advanced, and for differential geometry much more meaningful examples, 
is approached by the At iyah-Patodi- Singer Index Theorem, see Section 2.4 below. 



Proof of Theorem 2.3. (After [Ho63, p. 266 f.]) Since the coefficients of 
the differential operators (A, ^) are real, we may restrict ourselves to real func- 
tions. Thus, u e C^{X) denotes a single real- valued function, rather than a 
complex- valued function. 

Ker(A, ^): It is well-known that Ker(A) consists of real (or imaginary) parts 
of holomorphic functions on X (e.g., see [Ah53, p. 175 ff.]). Hence, u G Ker(A), 
exactly when u = ^{f) where f = u-\-iv is holomorphic; i.e., the Cauchy-Riemann 
equation || = 0 holds, where ^ •= |(^ +^^)- Explicitly, 



^ 1 

dz 2 



dx dy 



{u -h iv) 



du 

dx 



i f du 

dy) ^ 2 \dy ^ dx ) ’ 



Every holomorphic (= complex differentiable) function / is twice complex differ- 
entiable and its derivative is given by 

df 1/5 . 5 \ , 

1 / du i / du du .du 

2 \ 5x 2 \ dy^dx) dx ^ dy 



In this way we have a holomorphic function 0 := /' for each u G Ker(A). Since 



du 






dx dy) ) 



= ^{4>{z)zn, 
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the boundary condition = 0 (ly = z^) then means that the real part ^((/)(z)zP) 
vanishes for \z\ = 1. For p > 0, (j){z)zP is holomorphic as well as </>, and hence for 
<^(^) '■= have 

u e Ker ^A, ^ j with i/ = z^, p>0, 

^ ^{(f){z)z^) G Ker(A,i^) where R{-) = (•) |ax- 

Thus, we succeed in associating with the “oblique- angle” boundary value problem 
for u a Dirichlet boundary value problem for 3^ {(j){z)z'P)^ which has only the trivial 
solution by Example 2.2a. Since (!){z)z^ is holomorphic with ‘^{(j){z)z^) = 0, the 
partial derivatives of the imaginary part vanish, and so there is a constant C G M 
such that <l){z)z'P = iC for all z G X. If p > 0, then we have C = 0 (set z = 
0). Hence = 0, and (by the definition of (f)) the function u is constant (i.e., 
dimKer (A, = 1). If p = 0, then fy - = H^) = iC, and so u{x,y) = 

—Cy + (7, whence dimKer (A, = 2 in this case. 

We now come to the case p < 0, which curiously is not immediately reducible 
to the case q > 0 where q := — p. One might try to look for a solution by simply 
turning ^ around to — but this is futile since the winding numbers of iz and 
—ly about 0 are the same. Besides, if iZp (z) = z^, we do not have 
In order to reduce the boundary value problem with p < 0 to the elementary 
Dirichlet problem, we must go through a more careful argument. Note that (j){z)z^ 
can have a pole at z = 0, whence 3^ (^(z)z^) is not necessarily harmonic. We write 
the holomorphic function (f){z) as 



^(•^) = + 9 (z) 

j=0 

where q := — p, and g is holomorphic. We define a holomorphic function 'll; by 

q-l 

i)(z) ■,= g(z)z + '^ ajZ^~^ , 
with t'^(O) = 0. Then one can write 



q-l 

(l){z)z^ = Oq ^ (ajZ^~^ — ajZ^~^) -h 'ip{z) 
j=o 

The boundary condition ~ = 0 implies 5R((/)(z)z^) = 0 for |z| = 1. By the above 
equation, we have 0 = 3^(<^(z)z^) = 3^('0(z) -f Oq) for |z| = I since then z~^ = 
z. Since -0 is holomorphic, we have again arrived at a Dirichlet boundary value 
problem; this time for the function 3f^(0(z) + a^). From Example 2.2a, it follows 
again that 0(z) + Oq is an imaginary constant, whence 'ip{z) = 0(0) == 0 and Oq is 
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pure imaginary. We have 

q-l 

(f){z) = (j){z)z^z^ = aqZ^ -1- ^ 

3=0 

for arbitrary rq, ai, a^-i G C, and aq G iR. As a vector space over E, the set 

l«eKer(A,|;)} 

has dimension 2^ + 1; here we have restricted ourselves to real u, according to our 
convention above. Since u is uniquely determined by (j) up to an additive constant, 
it follows that for u = z^ and p < 0, 

dim Ker (A, = 2^ + 2 = 2 — 2p 

Coker (A, ^): As Example 2.2b shows the equation Au = F has a solution 
for each F G C^{X). In view of this we can show 

Coker (A, I;) = (c^{X) x C“(aA))/lm (A, |;) 

^C-(5X)/|;(KerA) 

as follows. We assign to each representative pair {F,h) G C^{X) x C^{dX) the 
class oi h — ^ G C^{dX), where u is chosen so that Au = F. This map is 
clearly well defined on the quotient space of pairs, and the inverse map is given 
by /i I— > (0, /i). Hence, we have found a representation for Coker (A, in terms 

of the “boundary functions” ^ Ker A}, rather than the cumbersome pairs 

in Im (A,|;). (This trick can always be applied for the boundary value problems 
(P, P), when the operator P is surjective.) 

We therefore investigate the existence of solutions of the equation Au = 0 
with the “inhomogeneous” boundary condition ^ where /i is a given 
function on dX. According to the trick introduced in the first part of our proof, it is 
equivalent to ask for the existence of a holomorphic function 0 with the boundary 
condition ^{(j){z)z^) — h, \z\ = 1, i.e., for a solution of a Dirichlet problem for 
^{(l){z)z^). By Example 2.2b, there is a unique harmonic function which restricts 
to h on the boundary dX; hence, we have a (unique up to an additive imaginary 
constant) holomorphic function 6 with 5i^(2) = h for [ 2:1 = 1. 

In the case p < 0, the boundary problem for (j) is always solvable; namely, set 
(j){z) := z~PQ{z). Hence, we have 

dim Coker (A, = 0 for i>{z) = z^ and p < 0. 

For p > 0, we can construct a solution of the boundary value problem in for 0 
from 6, if and only if there is a constant C G M, such that (0{z) — iC)/z'^ is 
holomorphic (i.e., the holomorphic function 6{z) — iC has a zero of order at least p 
at 2 ; = 0. Using the Cauchy Integral Formula, these conditions on the derivatives 
of ^ at z = 0 correspond to conditions on line integrals around dX, In this way, we 
have 2p — 1 linear (real) equations that h must satisfy in order that the boundary 
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value problem have a solution. We summarize our results in the following table 
(i/(z) = z^) and Figure 6: 



p 


dimKer (A, |;) 


dim Coker (A, 


index (A, 


> 0 


1 


2p- 1 


to 

1 

to 


<0 


to 

1 

to 


0 


2-2p 




Figure 6 . The dimensions of kernel, cokernel and the index of 
the Laplacian with boundary condition given by (z) := z^ for 
varying p. 



□ 

Note 1: We already noted in the proof the peculiarity that the case p < 0 
cannot simply be played back to the case p > 0. This is reflected here in the 
asymmetry of the dimensions of kernel and cokernel and the index. It simply 
reflects the fact that there are “more” rational functions with prescribed poles 
than there are polynomials with “corresponding” zeros. 

Note 2: In contrast to the Dirichlet Problem, which we could solve via inte- 
gration by parts (i.e., via Stokes’ Theorem), the above proof is function-theoretic 
in nature and cannot be used in higher dimensions. This is no loss in our special 
case, since the index of the “oblique- angle” boundary value problem must vanish 
anyhow in higher dimensions for topological reasons; see [Ho63, p. 265 f.]. The 
actual mathematical challenge of the function-theoretic proof arises less from the 
restriction dimX = 2 than from a certain arbitrariness, namely the tricks and 
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devices of the definitions of the auxiliary functions by means of which the 

oblique-angle problem is reduced to the Dirichlet problem. 

Note 3: The theory of ordinary differential equations easily conveys the im- 
pression that partial differential equations also possess a “general solution” in the 
form of a functional relation between the unknown function (“quantity”) the 
independent variables x and some arbitrary constants or functions, and that every 
“particular solution” is obtained by substituting certain constants or functions 
/, /i, etc. for the arbitrary constants and functions. (Corresponding to the higher 
degree of freedom in partial differential equations, we deal not only with constants 
of integration but with arbitrary functions.) The preceding calculations, regarding 
the boundary value problem of the Laplace operator, clearly indicate how limited 
this notion is which was conceived in the 18th century on the basis of geomet- 
ric intuition and physical considerations. The classical recipe of first searching for 
general solutions and only at the end determining the arbitrary constants and 
functions fails. For example, the specific form of boundary conditions must enter 
the analysis to begin with. 



Example 2.7. Let X := {z = x iy \ \z\ < 1} be the unit disk, and define 
an operator T : C^{X) x C^{X) -> C^{X) 0 C^{X) 0 C^{dX) by 
_ . . fdudv. . , \ 

where ^ ~ complex differentiation, and ^ 

the Cauchy-Riemann differential operator “formally adjoint” to ^ . We show that 

dim(KerT) == 1 and Coker(T) = {0}, and hence that index(T) = 1. 

Suppose that (u,u) G KerT. Then = 0 and = 0 in which case u 
and V are harmonic. Then, since [u — v) \qx = 0, we have u = v on X. Now 
^ = 0 implies that v is holomorphic, and (z) = = 0 implies that v 

(= u) is constant. Thus, dim(KerT) = 1. To show that Coker(T) = {0}, or more 
precisely (ImT)-^ = {0} (see the footnote to Example 2.2), we choose arbitrary 
functions f,g E C^(X), and h G C^{dX)^ and prove that /, g, and h must 
identically vanish, if 

for all u,v e C°^{X). Note that for P,Q ^ C^{X) we have 



d {Pdz + Qdz) - ^^dz Adz + ^-dz Adz — i 

oz oz \ oz oz 

= (^ - ^) {dx - idy) A {dx + idy) 



dz Adz 



= 2i 



dP 



dQ 

dz 



dx A dy. 
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Thus we obtain the complex version of Stokes’ Theorem, 

J Pdz + Qdz = J d{Pdz + Qdz) = 2i J 



fax 

From this, we get 



/, I / = X s = i L Vx “!• 

X S " = /x i - 2 = - s L "" "" " 1 



'I- 



Hence, 



L 



fdu dv 



■i 



“i+”l) + V,x 



Assuming (2.4), we have 



“=/x(S^ 

- - i (“S + ”1) + s L 



By considering and v with compact support inside the open disk, we deduce that 
II = 0 and If = 0 (i.e., / and g are analytic and conjugate analytic, respectively). 
Thus, (2.4) implies 

0= — [ {uf dz — vg dz) [ {u — v)h, 

2 ^ Jax Jax 

for all u,v ^ C^{X). Choosing v = u, we have 

0=7^ [ u{f dz — g dz) for all ^ ^ f dz = gdz on dX 
2^ Jax 



fax 

f (e^^) ie^^dO = -g (e^^) ie~^^de => f (e^^) = -g (e^^) e 



However, since f is analytic, the Fourier series of / (e^^) has a nonzero coef- 
ficient for only when m > 0, and since g is conjugate analytic, g (e^^) 
has a nonzero coefficient for only when m < 0. Thus, f = g = 0. Choosing 
V = —u^ the equation (2.4) then yields 

0 — {u- v)h = 2 / uh 

Jax Jax 

for all u e C^(X), which implies h = 0. 



Remark 2.8. In engineering, a system of separate differential equations 

Pu^f. 

Qv = g, 

related by a “transfer condition” R{u^ v) = h, is called a “coupling problem” . When 
the domains of u and v are different but have a common boundary (or boundary 
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part) on which the transfer condition is defined, then we have a “transmission 
problem”; see e.g. [Boo72, p.7 S\. Thus, we may think of T as an operator for a 
problem on the spherical surface X Uax X with different behavior on the upper 
and lower hemispheres, but with a fixed coupling along the equator. 

2.2. The index of twisted Dirac operators on closed manifolds. 

Recall that the index of a Fredholm operator is a measure of its asymmetry: 
It is defined by the difference between the dimension of the kernel (the null space) 
of the operator and the dimension of the kernel of the adjoint operator (= the 
codimension of the range). So, the index vanishes for self-adjoint Fredholm opera- 
tors. For an elliptic differential or pseudo-differential operator on a closed manifold 
M, the index is finite and depends only on the homotopy class of the principal 
symbol a of the operator over the cotangent sphere bundle S*M. It follows (see 
[LaMi, p. 257]) that the index for elliptic differential operators always vanishes 
on closed odd-dimensional manifolds. On even-dimensional manifolds one has the 
At iyah- Singer Index Theorem which expresses the index in explicit topological 
terms, involving the Todd class defined by the Riemannian structure of M and 
the Chern class defined by gluing two copies of a bundle over S*M by a. 

The original approach in proving the Index Theorem in the work of Atiyah 
and Singer [AtSi69] is based on the following clever strategy. The invariance of the 
index under homotopy implies that the index (say, the analytic index) of an elliptic 
operator is stable under rather dramatic, but continuous, changes in its principal 
symbol while maintaining ellipticity. Moreover, the index is functorial with respect 
to certain operations, such as addition and composition. Thus, the indices of elliptic 
operators transform predictably under various global operations (or relations) such 
as direct sums, embedding and cobordism. Using A-theory, a topological invariant 
(say, the topological index) with the same transformation properties under these 
global operation is built from the symbol of the elliptic operator. It turns out 
that the global operations are sufficient to construct enough vector bundles and 
elliptic operators to deduce the Atiyah-Singer Index Theorem (i.e., analytic index 
= topological index). With the aid of Bott periodicity, it suffices to check that the 
two indices are the same in the trivial case where the base manifold is just a single 
point. A particularly nice exposition of this approach is found in E. Guentner’s 
article [Gu93] following an argument of P. Baum. 

Not long after this first proof (given in quite different variants), there emerged 
a fundamentally different means of proving the Atiyah-Singer Index Theorem, 
namely the heat kernel method. This is outlined here in the important case of 
the chiral half of a twisted Dirac operator V. (In the index theory of closed 
manifolds, one usually studies the index of a chiral half instead of the to- 
tal Dirac operator P, since P is symmetric for compatible connections and then 
index P = 0.) The heat kernel method had its origins in the late 1960s (e.g., in 
[McK-Si]) and was pioneered in the works [Pa71], [Gi73], [ABP73], etc.. In the 
final analysis, it is debatable as to whether this method is really much shorter or 
better. This depends on the background and tastes of the beholder. Geometers 
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and analysts (as opposed to topologists) are likely to find the heat kernel method 
appealing, because K-theory, Bott periodicity and cobordism theory are avoided, 
not only for geometric operators which are expressible in terms of twisted Dirac 
operators, but also largely for more general elliptic pseudo-differential operators, 
as Melrose has done in [Me93]. Moreover, the heat method gives the index of a 
“geometric” elliptic differential operator naturally as the integral of a character- 
istic form (a polynomial of curvature forms) which is expressed solely in terms of 
the geometry of the operator itself (e.g., curvatures of metric tensors and connec- 
tions). One does not destroy the geometry of the operator by taking advantage of 
the fact that it can be suitably deformed without altering the index. Rather, in the 
heat kernel approach, the invariance of the index under changes in the geometry 
of the operator is a consequence of the index formula itself rather than a means 
of proof. However, considerable analysis and effort are needed to obtain the heat 
kernel for and to establish its asymptotic expansion as t 0^. Also, it can 

be argued that in some respects the K-theoretical embedding/ cobordism methods 
are more forceful and direct. Moreover, in [LaMi], we are cautioned that the in- 
dex theorem for families (in its strong form) generally involves torsion elements 
in K-theory that are not detectable by cohomological means, and hence are not 
computable in terms of local densities produced by heat asymptotics. Nevertheless, 
when this difficulty does not arise, the K-theoretical expression for the topological 
index may be less appealing than the integral of a characteristic form, particularly 
for those who already understand and appreciate the geometrical formulation of 
characteristic classes. All disputes aside, the student who learns both approaches 
and formulations will be more accomplished (and probably older). 

The classical geometric operators such as the Hirzebruch signature operator, 
the de Rham operator, the Dolbeaut operator and even the Yang-Mills operator 
can all be locally expressed in terms of chiral halves of twisted Dirac operators. 
Thus, we will focus on index theory for such operators. The index of any of these 
classical operators (and their twists) can then be obtained from the Local Index 
Theorem for twisted Dirac operators. This theorem supplies a well-defined rz-form 
on M, whose integral is the index of the twisted Dirac operator. This rz-form (or 
“index density” ) is expressed in terms of forms for characteristic classes which are 
polynomials in curvature forms. The Index Theorem thus obtained then becomes 
a formula that relates a global invariant quantity, namely the index of an operator, 
to the integral of a local quantity involving curvature. This is in the spirit of the 
Gauss-Bonnet Theorem which can be considered a special case. 

Definition 2.9. Let M be an oriented Riemannian rz-manifold (rz = 2m even) 
with metric /z, and oriented orthonormal frame bundle FM. Assume that M has a 
spin structure P — > FM, where P is a principal Spin (rz) -bundle and the projection 
P ^ FM is a two- fold cover, equivariant with respect to Spin(rz) ^ SO(rz). 
Furthermore, let P M be a Hermit ian vector bundle with a unitary connection 
e. The twisted Dirac operator V associated with the above data is 

(2.5) P (1 (g) c) o V : (P (8) E (M)) ^ (P (g) E (M)) . 
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Here, D (M) is the spin bundle over M associated to P FM — ^ M via the 
spinor representation Spin(n) — > End(Hn), 

c : (E (M) TM*) ^ (E (M)) 

is Clifford multiplication, and 

V (M)) ^ (E (8) E (M) (8 TM*) 

is the covariant derivative determined by the connection e and the spinorial lift to 
P of the Levi-Civita connection form, say on FM. 

Note that V here is a special case of an operator of Dirac type introduced in 
Section 1.3 with C1(M) acting on the second factor of T(8 E (M) which is playing 
the role of S. Let E^ (M) denote the ±1 eigenbundles of the complex Clifford 
volume element in (Cl(M)), given at a point x G M by i^ei • • - e^, where 
Cl, . . . , is an oriented, orthonormal basis of T^M. The E=^ (M) are the so-called 
chiral halves of E (M) = E“*“ (M) 0 E^" (M). Since 

V {C^ {E 8 E=^ (M))) CC^ {E^ E^ (M) 8 TM*) , and 
(1 8 c) (C'^ {E 8 E=^ (M) 8 TM*)) C (T 8 E^ (M)) , 

we have 

V = V+eV~, where : C°° {E (g) E±(M)) C°° (E (g S^(M)) . 

The symbol of the first-order differential operator T> is computed as follows. For 
(j) G (M) with (j)(x) = 0 and -0 G {E {^)) i we have at x 

(1 8 c) o V = (1 8 c) o {{d(j)) 'ip + (pV'ip) = (1 8 c) o (d0) xp 
= (1 8 c {d(p)) xp. 

Thus, the symbol <j(T>) : TxM* End(E(M)) at the covector (x ^ TxM* is 
given by 

CT {V) {^x) = 1 8 c (^x) ^ End {Ex 8 E^^) . 

For Cx 7 ^ 0, a {V) (^x) is an isomorphism, since 

a{V) {ij;)oa{V) 

Thus, V is an elliptic operator. Moreover, since a (T>+) and a {V~) are restrictions 
of <j (T>), it follows that V'^ and V~ are elliptic. It can be shown that V is formally 
self-adjoint, and and V~ are formal adjoints of each other (see [LaMi]). We 
also have a pair of self-adjoint elliptic operators 

V\ V‘^\C^ {E 8 E+ (M)) =V~ oV+ 

:= ^ ^ 2)+ o V~. 

For A G C, let 



(I>±) := {V' eC^{Eg S* (M)) I Vl^P = AV<} . 
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From the general theory of formally self-adjoint elliptic operators on compact 
manifolds, we know that 

Spec (^?|) = {A € C I Fa (7?|) ^ {0}} 

consists of the eigenvalues of and is a discrete subset of [0, oo), the eigenspaces 
V\ are finite-dimensional, and an {E 0 E^(M))-complete orthonormal set 
of vectors can be selected from the Va (^±)- Note that (Vx (^+)) Q Vx 
since for ip e V\ we have 

vl (D+v^) = (p+ o v~) ((p- o P+) (V^)) 

= P+ {Vl (^)) = P+ (X^) = AP+ ii ;) , 
and similarly V~ (Va (^-)) ^ Kx (^+)- For A 0, 

P^l^A (Vi) : Vx {Vl) Va {V^) 

is an isomorphism, since it has the inverse Thus the set of nonzero eigenvalues 
(and their multiplicities) of P^ coincides with that of P?_. However, in general, 

dim Vb(P+) - dim Vb(P?_) = dimKer(P^ ) - dimKer(P?.) - index(P+) ^ 0. 

Since dim V\(P^) — dim Va(P_) = 0 for A 7^ 0, obviously 

index(P^) = dim Vq(P^) — dimVo(T>?_) 

= ^ e-‘^ (dimV^ATi) - dimVxiVl)) . 

AeSpec(X>^) 

This may seem like a very inefficient way to write index (P"^), but the point is 
that the sum can be expressed as the integral of the supertrace of the heat kernel 
for the spinorial heat equation ^ from which the Local Index Theorem 

(Theorem 2.13 below) for P“^ will eventually follow. However, first the existence 
of the heat kernel needs to be established. 

Let the positive eigenvalues of P^ be placed in a sequence 0 < Ai < A2 < • • • , 
where each eigenvalue is repeated according to its multiplicity. Let uf , u J , . . . be an 
L^-orthonormal sequence in {E S+(M)) with P^ (n^) = ^j'^f (i-^-? ^ 

Faj (P±)). We let , . . . , Uq ^ be an -orthonormal basis of KerP^ = Ker P+, 
and let Uq^ , . . . , Uq be an L^-orthonormal basis of Ker P^ = Ker P_ . We can 
pull back the bundle E^E^ (M) via either of the projections M x M x (0, 00) ^ M 
given by tti (x,y,t) x and (x,y,t) := y, and take the tensor product of the 
results to form a bundle 

JC^ := 7T* {E 0 (M)) ^7t*{E^ (M)) M x M x (0, 00) . 

Note that for x G M, the Hermitian inner product ( , )^ on (E (g) E=*=(M))^ gives 
us a conjugate-linear map 'ip ^ 'ip'^ (•) := from [E (g) E=^(M))^ to its dual 
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space {E E^(M))*. Thus, we can (and do) make the identifications 
7T* {E (8) S=^(M)) 8 7T* (£- 8) S=^(M)) 

^ (tti* {E 8 S±(M)))* 8 7t5 (£; 8 E±(M)) 

^ Horn (tt* {E 8 E±(M)) , ttJ (E 8 5]=^(M))) . 

The full proof of the following Proposition 2.10 will be found in [BlBo04], but it 
is already contained in [Gi95] for readers of sufficient background. 

Proposition 2.10. For t > to > 0, the series defined by 

oo 

k'^ (x, y, t) := y] (x) 0 uf (y) 

j = l 

converges uniformly in x M x (to,oo)) for all q > 0. Hence G 

coo and {for t > 0) 

Q oo 

(2.6) {x, y,t) = ~Y^ {x) ® uf (y) = (x, y, t) . 

Definition 2.11. The positive and negative twisted spinorial heat kernels 
k± ^ (^oo (/c=^) (or the heat kernels for T)\) are given, for i > 0, by 

k^ {x, y, t) := ^ uf {x) 0 uf (y) + k'^ {x, y, t) 

i=l 

oo 

= ® + E^e~^'^uf(x) 0 uf{y). 

i=l j=l 

The total twisted spinorial heat kernel (or the heat kernel for P^) is 

(2.7) k = {k+,k-) G (/C+) 0 {JC-) ^ (/C+ 0 /C") C (/C) , 

where AC /C+ 0 /C” = Horn (tt^* {E 8 S(M)) , ttJ (£; 8 5](M))). 

The terminology is justified in view of the following result, whose proof is to 
be found in [BlBo04]. 

Proposition 2.12. Let g {E 8 E=^(M)), and let 

'Ip^{x,t)^ {k^{x,y,t),-ipf{y))uy. 

JM ^ 

Then for t > 0, -0^ solves the heat equation with initial spinor field : 

and lim^ 0^ (•, t) = 0^ in for all q>0. 

Moreover, for 0o G {E 8 5](M)) and 
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we have ^ cLnd lim 'll; (*,t) = 0o (•) for all q>0. 

ot t-^o+ 

For any finite dimensional Hermitian vector space (V, (•,•)) with orthonormal 
basis Cl, . . . , ejv, we have (for v eV) 



Tr (r* (g) ^ {{v* (g v) (e^) , ^ (v* (e^) v, 



^((ei,'i;)i;,e0 = (v,ei) = ^ Ke^ 






In particular, (x, x, t) 6 End {{E (g E^(M))^), and 



Tr{k^{x,x,t)) =Y^\u^^{x)\ • 

i=l j=l 

Since this series converges uniformly and ||^JJ |2 q ~ 11^^112 o ~ have 

« oo 

/ Tr {x, x, t)) Ux = e~^^^ < oo. 

•/M 

For t > 0, we define the bounded operator e“^^± G End (L^ (£* (g E^(M))) by 

oo 

e“‘®± (^±) = ^ (m± , M± + ^ (wf - V'?) • 

j=l 

Note that e“^^± is of trace class, since 

Tr T e~^^* = J Tr (x, x, t)) < oo. 



Now, we have 



index(P+) - dim To (^^+) ~ dimFo(^_) 



= n' — n 



+E(' 



e - e 






= f [Tr {k^ {x,x,t)) -Tr [k (x,x,t))) 
Jm 



(2.8) 
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Since T>^ = V\ 0 D?., we also have the operator e G End {E 0 E(M))), 
which is of trace class and whose trace is given by 

Tr(e“*^^)= [ Ti{k{x,x,t))i/x = ( {Ti{k'^{x,x,t)) i-TT{k~{x,x,t))) 

Jm Jm 

The supertrace of k {x, x,t) is defined by 

Str {k (x, X, t)) := Tr (/c“^ (x, x, t)) — Tr (/c“ (x, x, t)) , 
and in view of (2.8), we have 

(2.9) index (r>+) = / Str {k (x,x,t)) 

Jm 

The left side is independent of t and so the right side is also independent of t. 
The main task now is to determine the behavior of Str (A: (x, x, t)) as ^ 0^. 

We suspect that for each x G M, as t 0"^, k{x,x,t) and Str (A: (x, x, t)) are 
infiuenced primarily by the geometry (e.g., curvature form of M with metric h 
and Levi-Civita connection 0, and the curvature of the unitary connection for 
E) near x, since the heat sources of points far from x are not felt very strongly at 
X for small t. Indeed, we will give an outline a proof of the following Local Index 
Formula, the full proof of which will appear in [BlBo04]. 

Theorem 2.13 (The Local Index Theorem). In the notation of Definitions 2.9 
and 2.11, let V : (E 0 E (M)) ^ (E (g) E (M)) be a twisted Dirac operator 

and let k G {)C) be the heat kernel for . If is the curvature form of 
the unitary connection e for E and is the curvature form of the Levi-Civita 
connection 6 for (M, h) with volume element v, then 

(2.10) ^lim Str {k {x, x, i)) = ( IV ^ det (-g^^) 

Remark 2.14. As will be explained below, the right side is really the inner 
product (with volume form u at x) of the canonical form ch{E,£) ^ A(M, 0) (de- 
pending on the connections s for E and the Levi-Civita connection 6 for the metric 
h) which represents ch{E) ^ A(M). As a consequence, we obtain the Index The- 
orem for twisted Dirac operators from the Local Index Formula in Corollary 2.15 
below. Thus the Local Index Formula is stronger than the Index Theorem for 
twisted Dirac operators. Indeed, the Local Index Formula yields the Index Theo- 
rem for elliptic operators which are locally expressible as twisted Dirac operators 
or direct sums of such. 

Corollary 2.15 (Index formula for twisted Dirac operators). For an oriented 
Riemannian n-manifold M (n even) with spin structure, and a Hermitian vector 
bundle E ^ M with unitary connection, let V = 0 D~ be the twisted Dirac 

operator, with {E 0 E“*“(M)) ^ {E 0 E“(M)). We have 

(2.11) index(D+) = (ch(F) - A(M)) [M] , 
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where ch{E) is the total Chern character class of E and A(M) is the total A class 
of M, both defined below. In particular, we obtain: 

For n = 2; 

index — chi{E)[M] = ci(E)[M]. 

For n = 4; 

index (P+) - (ch(£;) - A(M))[M] 

= {-dimE-^Pi{TM)+ch 2 {E))[M] 

= ( - i dim i? ■ Pi (TM) + ici {Ef - C 2 {E)) [M]. 



Proof. By (2.9), (2.10) and the above remark, we have 
index (X>^)= / Str{k{x,x,t)) Ux 

JM 



= lim / Str(k(x,x,t)) i/x — / hm Stv{k{x,x,t)) i/x 
^^ 0 + Jm ^-" 0 + 

= [ {chiE,e)x - MM,0)x. vx)v. = {ch{E) ^ A{M))[M]. 

JM 



□ 



We now explain the meaning of the form 






iQ,^ I 4 t\ 



i)'- 



^sinh(iO^/47r) > 

The first part Tr (e^^^/^^) is relatively easy. We have (recall dimM = 2m) 



( 2 . 12 ) 



oOi/.\/c m ^ \ k 



k=0 






where A A e fi2'=(End(S)). Also, Tr A A fl^) G and 

m 

Tr(e*fiV27T) e (Af). 

fc=l 

This (by one of many equivalent definitions) is a representative of the total Chern 
character ch(£^) G 0^i The curvature of the Levi-Civita con- 

nection 0 for the metric h has values in the skew-symmetric endomorphisms of 
TM\ i.e., QP G (End (TM)). A skew-symmetric endomorphism of say 
B G so(n), has pure imaginary eigenvalues ±ir/c, where G M (1 < A: < m). 
Thus, iB has real eigenvalues ir^. Now g^^h(f/ 2 ) ^ power series in z with ra- 
dius of convergence 2tt. Thus, is defined for s sufficiently small and has 
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eigenvalues repeated twice. Hence 



( si.I(f/i/2) ) = ft Uxv/2) f' “<* “ 

/ isB/2 \ ^ ^ fj '<'ksl2 
l^sinh(isS/2)/ sinh(rfcs/2) 



The last product is a power series in s of the form 



(2.13) 



yr ns/2 
sinh (rfcs/2) 



E 

k=0 



dk {ri, ■ 



^2k 



where each coefficient a/c(rf , . . . , r^) is a homogeneous, symmetric polynomial in 
rf , . . . , of degree k. One can always express any such a symmetric polynomial 
as a polynomial in the elementary symmetric polynomials <Ji , . . . , am in , . . . , r^, 
where 

mm m 



a2 = Y^r\r] 

1=1 i<j 



E 2 2 2 

•••• 

i<j<k 



These in turn may be expressed in terms of SO(n)-invariant polynomials in the 
entries of H G so{n) via 



det (A/ 



On the other hand, 



-B) = n - ifj ) = n 

1=1 i=i 

m 

k=l 



det(A7 - B) = ^ 



fe = l 



{ 2 ky 



E 

W.(i) 






■J2k JDll 
■i2k jl 



J2k 



i 2 k ] \2{m-k) 

hk I ^ ’ 



and so 

ai (r‘^ r‘^ i ^ ^h"-32k oh . . . jDi2k 

where (i) = (h? ’ * * ? hk) is an ordered 2fc-tuple of distinct elements of {1, ... , 2m} 
and (j) is a permutation of (i) with sign If we replace Bj with the 2-form 

relative to an orthonormal frame field, we obtain the Pontryagin forms 

{ 2 ^r\ 2 k)l E^ ^ 

which represent the Pontryagin classes of the SO(n) bundle FM. Note that pk{0,^) 
is independent of the choice of framing by the ad-invariance of the polynomials 
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(j/c- If we express the a/c(rf , . . . , r^) as polynomials, say Akicri, • • • , <Tfc), in the aj 
{j < k), we can ultimately write 



det 



isBf2 

smh.(isB/2) 



k=0 



Formally replacing B by , we finally have the reasonable definition 



/ /4tt \ ^ 
\sinh(iO^/47r) ) 



k=0 



where the Pj (O^) are multiplied via wedge product when evaluating the terms in 
the sum; the order of multiplication does not matter since Pj{0>^) is of even degree 
4j. Also, since Ak (pi(O^), . . . ,pfc(0^)) is a 4/c-form, there are only a finite number 
of nonzero terms in the infinite sum. Abbreviating Pj{0.^) simply by pj, one finds 

, / iOV47r \ ^ , 1 1 2 . X 

(2.14) Uml.(m»/4.) j = ‘ - a"- + 5760<^'’' “ 



This (by one definition) represents the total A-class of M, denoted by 

m 

(2.15) A(M)€0/f"'=(M,Q), 

k=l 

where actually A(M) has only nonzero components in when k is even 

(or 2k = 0 mod 4). In (2.10) the multi-degree forms (2.12) and (2.14) have been 
wedged, and the top (2m-degree) component (relative to the volume form) has 
been harvested. 



We now turn to our outline of the proof of Theorem 2.13. The well-known 
heat kernel (or fundamental solution) for the ordinary heat equation Ut = Au in 
the Euclidean space is given by 

(2.16) e (x, y, t) — {47rt)~^^^ exp \x — y\^ /4t^ . 

Since H (x,y,t) only depends on r = \x — y\ and t, it is convenient to write 

(2.17) e (x^yA) = ^ {T,t) := {47rt)~^^^ exp ( — r^/4t). 

We do not expect such a simple expression for the heat kernel k = {k~^ ,k~) from 
Definition 2.11. However, it can be shown that for x^y G M (of even dimension 
n = 2m) with sufficiently small Riemannian distance r = d(x, y) from x to we 
have an asymptotic expansion as ^ ^ 0“^ for A: (x, y, t) of the form 

Q 

k{x,y,t) ~ Hq{x,y,t) := £{d{x,y),t)'^hj{x,y)t\ 

j=0 



(2.18) 
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for any fixed integer Q > m + 4, where 

hj{x, y) € Horn ((£; ® S(M))„ {E ® E(M))y) for j € {0, 1, , Q). 

The meaning of k{x^y^t) ~ Hqix^y^t) is that for d{x,y) and t sufficiently small, 
\k{x,y,t) - HQ{x,y,t)\ < Cq E{d{x,y),t)t^'^^ < 
where Cq is a constant, independent of (x,y,t). We then have 

Q Q 

(2.19) k{x,x,t) ~ {4:7Tt)~^'^^hj{x,x)t^ = (47t)~^ hj{x, x)t^~^. 

j=0 j=o 

Using (2.9), i.e., Stv{k{x,x,t)) = index(P'^), and (2.19), we deduce that 

/ Str(hj(a:,a:)) i^x = ^ for j G {0, 1, . . . , m — 1}, while 
Jm 

/ StT{hm{x,x)) i^x = / Str(/c(rr,x,^)) = index(T>+). 

Jm Jm 

Thus, to prove the Local Index Formula, it suffices to show that 

(4rr)- StvihUx, x)) = {Tt ^ ^et ^ r.,). 

While this may not be the intellectual equivalent of climbing Mount Everest, it is 
not for the faint of heart. 

We choose a normal coordinate system (y^,...,y^) in a coordinate ball B 
centered at the fixed point x G M, so that (y^, . . . ,y^) =0 at x. The coordinate 
fields di := d/dy^,...,dn := djdy^ are orthonormal at x, and for any fixed 
yo ^ B with coordinates (yg, . . . , ), the curve t ^ t(yQ,...,yg) is a geodesic 

through X. By parallel translating the frame (^i, . . . ,^n) at x along these radial 
geodesics, we obtain an orthonormal frame field {Ei, . . . , En) on B which generally 
does not coincide with (9i, . . • , 5n) at points y ^ B other than at x. The framing 
{El, . . . ,En) defines a particularly nice section B — > FM\B and we may lift this 
to a section B P\B of the spin structure, which enables us to view the space 
C^{T,{M)\B) of spinor fields on B as C'^(B, E^), i.e., functions on B with values 
in the fixed spinor representation vector space = E+ 0 E“. By similar radial 
parallel translation (with respect to the connection e) of an orthonormal basis of 
the twisting bundle fiber Ex, we can identify C^{E\B) with C^{B,C^), where 
N = dime E. The coordinate expressions for the curvatures and are as 

simple as possible in this so-called radial gauge. 

With the above identifications, we proceed as follows. For 0 < Q € Z, let 
G C^{B X (0, oo), (g) Ti2m) be of the form 

Q 

^Q{y,t) ■.= S{r,t)Y,Uk{y)t\ 
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where Uk ^ 0 D 2 m)- If Uq{ 0) e 0 T> 2 m is arbitrarily specified, we 

seek a formula for Uk{y), k = 0, . . . such that 

(2.20) (p2 + dt)^Q(y, t) = f (r, t)t«p2([7Q)(t/). 

By virtue of the generalized Lichnerowicz formula (see [LaMi, p. 164]), the square 
of the Dirac operator V can be written as 

PV = -AV> + i ^ ^ Q.%Ej -Ek-^+ 

where is Clifford multiplication. It is convenient to define the 0-th order oper- 
ator T on C^(B, <S> '^ 2 m) via 

•^[^1 ■= 5 Ylj k ■ Ek-tp, so that 

V^ = -Ai^ + {E+\SM. 

The desired formula for the Uk{y) involves the operator A on (K) S 2 m) 

given by 

Ali;] := -h^l^V\hr^l^\ = - (^+ 

where (\/detfi)^/^. For s G [0, 1], let 

As is proved in [Ble92] or in the forthcoming book [BlBo04], we have: 

Proposition 2.16. Lei /7o(0) G (g) E2m; let Vo G (g) E2m) 

be the constant function Vo{y) = Uo{0). Then the Uk{y) which satisfy (2.20) are 
given by 

Uk{y) = fi(y)~^^'^Vfc(y), where 

(2.21) r 

yk{y) = / Y[{siy{As^_^ o ‘ ■ o Aso[Vo]){y) dso . . .dsk-u 

z =0 

and where — {(sq, . . . s^) | G [0, 1] for i G {0, . . . , /c — 1}}. 

Note that Pq( 0) G (g E 2 m niay be arbitrarily specified, and once /7o(0) is 
chosen, the Um{y) are uniquely determined via (2.21). Let hk{y) G End(C^gE 2 m) 
be given by 

( 2 . 22 ) hk{y){Uom := Uk{y) 

(in particular, fio(O) = / G End(C^ g E 2 m)), and 

Q 

Hq{ 0, y, t) := £{t, t) ^ hu{y)t^ G End(C'^ ® Sa^)). 

k :^0 

We may regard ffg(0,y,t) as 

HQ{x,y,t) ^ Horn {Ex g E{M)x,Ey g E(M)^), 
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where we recall that x e M is the point about which we have chosen normal 
coordinates. For y sufficiently close to 2:, we set 

Q 

(2.23) HQ{x,y,t) := S{d{x,y),t)^hk{x,y)t’^ . 

fc =0 

Of course, one expects that HQ{x^y^t) provides the desired asymptotic expansion 
(2.18). Although this is very plausible, it is not at all easy to prove honestly. When 
proofs are attempted in the literature, often steps are skipped, hands are waved, 
and errors are made. An extremely careful (and hence nearly unbearable) proof 
will be provided in [BlBo04], but we must forgo this here. Thus, we will only state 
here without proof that 

Q 

k{x,y,t) ~ Hq{x,y,t) := £{d{x,y),t)'^hj{x,y)f 

i=o 

for d{x,y) sufficiently small, where the hj are given in (2.22). 

Using normal coordinates (y^ , . . . , y^^) G B{ro^ 0) about x G M and the radial 
gauge, and selecting Vo G (8) by Proposition 2.16, we have 

/ m— 1 

dSQ . . . dSm-l, 

2 = 0 

where Vq G C^{B{ro^0)^C^ 0 ^2m) is the constant extension of Vq. Recall that 
for ^ G C^(B(ro,0), 0 ^ 2 m), we have 

^sbPKy) := A[i(j]{sy), where A[ip] := ~ {^ + \S)[ip]. 

While the right side of (2.24) may seem unwieldy, there is substantial simplification 
due to facts that o • • • o A^^) [Vq] (y) is evaluated at y = 0 in (2.24). Also, 

if 7 ^, ... ,7^ denote the so-called gamma matrices for Clifford multiplication by 
^1 , . . . , only those terms of o • • • o Ag^) [Vo](0) which involve the product 

7^+1 := 7^ . • .7^ will survive when the supertrace Str (A„^ (^,^)) is taken. As a 
consequence, we have the following simplification (essentially contained in [Ble92], 
or better yet, to appear in [BlBo04]) 

Proposition 2.17. Let Rkiji{0) — h{OP{di,dj)dudk) denote the components 
of the Riemann curvature tensor of h at x, and let Vifj(O) Q^{di,dj) at x. Set 

k,l,i 

^ •■= 5 E = 5 E 

id 
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For Vq G H 2 m; define 



(2.25) C(0,0)(Fo) 



^ m — 1 

/n (».)•((' 



jTo])(0)dso... 






where Vq G C^(5(ro, 0), (8)5]2m) ^<5 constant extension ofVo 

Then 



(2.26) Str(/i„(0,0)) = Str(/i^(0,0)). 

In other words, in the computation of SiT{hm{0, 0)) given by (2.24)^ we may replace 
A by A^. 



This is a substantial simplification, not only in that A^ is a second-order 
differential operator with coefficients which are at most quadratic in y, but it also 
shows that StT{hm{x,x)) only depends on the curvatures and at the point 
X. One might regard the gist of the Index Formula for twisted Dirac operator 
as exhibiting the global quantity index(P+) as the integral of a form which may 
be locally computed. From this perspective, Proposition 2.17 does the job. Also, 
knowing in advance that index(D+) is insensitive to perturbations in h and e, one 
suspects that Str{hm{x,x)) Ux can be expressed in terms of the standard forms 
which represent characteristic classes for TM and E. The Local Index Formula 
confirms this. Moreover, for low values of m, say m = 1 or 2 (i.e., for 2 and 
4-manifolds), one can directly compute Str(/i^(0, 0)) using (2.25), and thereby 
verify Theorem 2.13 and hence obtain Corollary 2.15 rather easily. For readers who 
have no use for the Local Index Theorem beyond dimension 4, this is sufficient. 
It requires more effort to prove Theorem 2.13 for general m. For lack of space, 
we cannot go into the details of this here, but they can be found in [Ble92] or 
[BlBo04]. It is well worth mentioning that the appearance of the sinh function in 
the Local Index Formula has its roots in Mehler’s formula for the heat kernel 



(2.27) ea(x,y,t) = 






exp 



i sinh(2at) 



(cosh(2at){x^ + y^) — 2xy) ) . 



of the generalized 1-dimensional heat problem 

Ut = Uxx — ofx^u, u{x, t) G M, [y, t) G Ex (0, oo), 
i/(rr,0) = f{x), 



where 0 ^ a G E is a given constant. A solution of this problem is given by 

/ oo 

ea{x,y,t)f{y)dy, 

-OO 

and this reduces to the usual formula as a ^ 0. The nice idea of using Mehler’s 
formula in a rigorous derivation of the Local Index Theorem appears to be due 
to Getzler in [Get83] and [Get86], although it was at least implicitly involved in 
earlier heuristic supersymmetric path integral arguments for the Index Theorem. 
In the same vein, further simplifications and details can be found in [BeGeVe92], 
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Figure 7. The partition of M = Mi Ue M 2 



[YuOl], and [Ble92], but the treatment to be found in [BIB 004 ] will be more 
self-contained and less demanding. 

While the Local Index Theorem (Theorem 2.13) is stated for twisted Dirac 
operators, the same proof may be applied to obtain the index formulas for an 
elliptic operator, possibly on a nonspin manifold, which is only locally of the form 
of twisted Dirac operator V^, Indeed, if A is such an operator and k is the heat 
kernel for A*A^AA*, then from the spectral resolution of A, we can still deduce 
from the asymptotic expansion of k that 

index(^) = (47 t)~"^ / Sir{hm(x,x)) Ux, 

Jm 

where the supertrace Str is defined in the natural way. The crucial observation is 
that since A is locally in the form of a twisted Dirac operator, we can compute 
Str(h,^(x, x)) in exactly the same way (i.e., locally) as we have done. Since it is 
not easy to find first-order elliptic operators of geometrical significance which are 
not expressible in terms of locally twisted Dirac operators (or 0-th order perturba- 
tions thereof), the Local Index Formula for twisted Dirac operators is much more 
comprehensive than it would appear at first glance. 

2.3. Dirac type operators on manifolds with boundary. In this section 
we fix the notation and recall some basic properties of Dirac type operators on 
manifolds with boundary. 

2.3.1, The general setting for partitioned manifolds. Let M be a compact 
smooth Riemannian partitioned manifold 

M = Ml Ue M2 ’= Ml U M21 

where Mi H M 2 = dMi = dM 2 = 5], and E is a hypersurface (see Figure 7). We 
assume that M \ E does not have a closed connected component (i.e. E intersects 
any connected component of Mi and M 2 ). Let 

V : C^{M]S) C^{M]S) 
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be an operator of Dirac type acting on sections of a Hermitian bundle S of Clifford 
modules over M, i.e., V = coV where c denotes the Clifford multiplication and 
V is a connection for S. Unlike the more general case introduced in Section 1.3, 
we assume here that V is compatible with c in the sense that Vc = 0. From this 
compatibility assumption it follows that D is symmetric and essentially self-adjoint 
over M. 

For even n — dimM, the splitting C1(M) = 0 €i~ {M) of the Clifford 

bundles induces a corresponding splitting of = 5"^ 0 5“ , and a chiral decompo- 
sition 

of the total Dirac operator. The chiral Dirac operators are elliptic but not 
symmetric, and for that reason they may have nontrivial indices which provide us 
with important topological and geometric invariants, as it was found in the special 
case of twisted Dirac operators in Section 2.2. 

Here we assume that all metric structures of M and S are product in a collar 
neighborhood N = [—1,1] x E of E. li u denotes the normal coordinate (running 
from Ml to M 2 ), then 

d 

D\n = (r{du 0 B) , where a := c (du ) , , 

and B denotes the canonically associated Dirac operator over E, called the tan- 
gential operator. We have a similar product formula for the chiral Dirac operator. 
Here the point of the product structure is that then a and B do not depend on the 
normal variable. Note that a (Clifford multiplication by du) is a unitary mapping 
L^(E;*S|s) ^ ^^(S; *^|e) with == —I and aB = —Ba. In the non-product case, 
there are certain ambiguities in defining a ‘tangential operator’ which we shall not 
discuss here (but see also Equation (1.9)). 

2.3.2. Analysis tools: Green’s formula. In order to simplify the notation we 
set X := M 2 . For greater generality, we consider the chiral Dirac operator 

: C^(X;5+) ^ C^(X;5“) 

and write V~ for its formally adjoint operator. The corresponding results follow 
at once for the total Dirac operator. 

Lemma 2.18. Let (•, -)± denote the scalar product in L'^{X;S^). Then we have 

/+,/-)- - (/+T"/->+ = -^(<77oo/+,7oo/-) envois 

for anyf^€C°°(X-,S^). 

Here, 

(2.28) 7oo:C°°(X;5±)^C~(E;5±|e) 

denotes the restriction of a section to the boundary E. 
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2.3.3. Cauchy data spaces and the Calderon projection. To explain the 
Cauchy data spaces we recall three additional, somewhat delicate and not widely 
known properties of operators of Dirac type on compact manifolds with boundary, 

cf. [BoWo93]: 

1. The invertible extension to the double. 

2. The Poisson type operator and the Calderon projection. 

3. The twisted orthogonality of the Cauchy data spaces for chiral and total 
Dirac operators which gives the Lagrangian property in the symmetric case 
(i.e., for the total Dirac operator). 

The idea and the properties of the Calderon projection were announced in 
Calderon [Ca63] and proved in Seeley [Se66] in great generality. In the follow- 
ing, we restrict ourselves to constructing the Calderon projection for operators of 
Dirac type (or, more generally, elliptic differential operators of first order) which 
simplifies the presentation substantially. 

2.3.4. Invertible extension. First we construct the invertible double. Clifford 
multiplication by the inward normal vector gives a natural clutching of 5“*" over 
one copy of X with S~ over a second copy of X to a smooth bundle 5+ over the 
closed double X. The product forms of D+ and V~ = (D+)* fit together over the 
boundary and provide a new operator of Dirac type, namely 

(2.29) := U P" : C^{X, S+) C^(X, S^). 

Clearly (P+ U P“)* = T>~ U and so index P+ = 0. It turns out that P+ is 
invertible with a pseudo-differential elliptic inverse (P+)“^. Clearly, local solutions 
of the homogenous equation (here, solutions on one copy of X) do not extend to 
global solutions on X in general. As a matter of fact, the operator P+, even being 
the restriction of an invertible, locally defined differential operator, is not invertible 
in general, and we have r+(P+)"^e+P+ ^ /, where e+ : L^(X; 5+) L‘^{X\ aS+) 

denotes the extension- by- zero operator and r+ : H^{X]S^) H^{X\S^) the 

natural restriction operator for Sobolev spaces for s real. The precise decomposi- 
tion L^(A; 5+) = L‘^{X] 5+) x L^(A; 5~) gives a different picture in case that a 
given operator T on one component can be extended to an invertible operator T on 
the whole space. This, indeed, would imply T invertible with T~^ = r+(T)“^e+. 
The LP" extension of P+, however, is not a precise extension of the extension 
of P+. Therefore, in our case, the L^-argument breaks down. 

Example 2.19. In the simplest possible two-dimensional case we consider 
the Cauchy-Riemann operator d : C^{D‘^) C^{D‘^) over the disc P^, where 

d — \{dx + '^9y). In polar coordinates, this operator has the form 
Therefore, after some small smooth perturbations (and modulo the factor ^), we 
assume that d has the following form in a certain collar neighborhood of the 
boundary: 

d^e^^{dr + id^) 
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Now we construct the invertible double of the operator d. By /c C Z, we 
denote the bundle, which is obtained from two copies ofD^xC by the identification 
{z^w) = ( 2 , z^w) near the equator. We obtain the bundle by gluing two halves 
of X C by and E~^ by gluing with the adjoint symbol. In such a 

way we obtain the operator 

d:=du{dy : C^iS^'E^) ^C^{S^;E-^) 
over the whole 2-sphere. 

Let us analyze the situation more carefully. We fix N" := {—e,-\-e) x 5^, a 
bicollar neighborhood of the equator. The formal adjoint of d has the form 

(By = e~^^{-du + id^ + l) 

(n = r — 1) in this cylinder. A section of E^ is a couple (si, S 2 ) such that in N, 

S2 . 

The couple (5s 1 , (5) * 52 ) is a smooth section of E~^. To show this, we check that 
(5)*S2 = e~'^'^dsi. In the neighborhood A, we have 

(Bys2 = (By (e'^si) = {-du + id^ + 1) (e^^si) 

= duSi + (e'^^si) + Si = {du + id^) si 

= {du + id^) si = (5si) . 

Then the operator 5 U 5* becomes injective and index 5 U 5* = 0. 

2.3.5. The Poisson operator and the Calderon projection. Next we investigate 
the solution spaces and their traces at the boundary. For a total or chiral operator 
of Dirac type over a smooth compact manifold with boundary E and for any real 
s we define the null space 

Ker(D+, s) {/ G H^{X] *S+) | D+/ = 0 in A \ E}. 

The null spaces consist of sections which are distributional for negative s; by 
elliptic regularity they are smooth in the interior; in particular they possess a 
smooth restriction on the hypersurface E^ = {e} x E parallel to the boundary E 
of A at a distance e > 0. By a Riesz operator argument they can be shown to 
also possess a trace over the boundary. Of course, that trace is no longer smooth 
but belongs to 77^“ 2 (El; 5"^ |s)- More precisely, we have the following well-known 
General Restriction Theorem (for a proof see e.g. [BoWo93], Chap. 11 and 13): 

Theorem 2.20. 

(a) Let s > |. Then the restriction map 700 of (2.28) extends to a bounded map 

(b) For s < ^, the preceding reduction is no longer defined for arbitrary sections 

but only for solutions of the operator V'^ : let f G Ker(D+,s) and let 7(e)/ 
denote the well-defined trace of f in C^(Eg; ^“^Is). Then, as e 0_|_, the 
sections 7(e)/ converge to an element ^sf ^ (E; /S'“^|e)- 
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(c) Let denote the invertible double of T>^ , and let denote the restriction 
operator r^ : H^{X\S^) and let 7 ^ be the dual of in the 

distributional sense. For any 5 G R the mapping (Poisson type operator) 

!C := r+(P?)“S;,cr : C~(E; 5+|s) ^ C°°(X;5+) 

extends to a continuous map ^ H^{X]S'^) with 

range = Ker(D'*",s). 

For 5 = 0, Theorem 2.20 can be reformulated in the following way: 
Corollary 2.21. For a constant C independent of f, we have 
Il7(/)ll_i <C(||P+/||o + ll/llo) forallfeDm..{V+), 
where Dmax •= {f ^ {^1 I ^ (^5 »^)}- the restriction 

7 : i^max {V+) 
is well defined and bounded. 

Proofs of the previous theorem and corollary can be found, e.g., in [BoWo93], 
Theorems 13.1 and 13.8 for our situation {V^ is of order 1); and in Hormander 
[H 066 ] in greater generality (Theorem 2.2.1 and the Estimate (2.2.8), p. 194). 
The composition 

(2.30) P(P+) := Too o/C : C""(E;5 +|e) ^ C""(E;5+|s) 

is called the {Szego-) Calderon projection. It is a pseudo-differential projection 
(idempotent, but in general not orthogonal). We denote by P(P+)(^) its extension 
to the 5-th Sobolev space over E. It has the following geometric meaning. 

We now have three options for defining the corresponding Cauchy data (or 
Hardy) spaces: 

Definition 2.22. For all real 5 we define 

A(P+,s) := 7s(Ker(P+,s)), 

^H=-i(£;S+|s) 

s) := 7oo{/ e C-(X; 5+) | P+/ = 0 in X \ e| 

ACaid(p+^g) _ range . 

The range of a projection is closed; the inclusions of the Sobolev spaces are 
dense; and range 7^ (P”'") = 7oo{/ ^ C^(X;5“^) [ f = 0 in X\E}, as shown 
in [BoWo93], So, the second and the third definition of the Cauchy data space 
coincide. Moreover, for 5 > | one has A(P+,5) = A^^^^(D+,5). This equality can 
be extended to the case (5 = ^, see also Theorem 2.31 below), and remains 
valid for any real 5 , as proved in Seeley, [Se66], Theorem 6. For s < |, the result 
is somewhat counter-intuitive (see also Example 2.24b in the following Section). 
In conclusion, we have: 
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Proposition 2.23. For all s eR 

2.3.6. Calderon and Atiy ah- Patodi- Singer projection. The Calderon projec- 
tion is closely related to another projection determined by the ‘tangential’ part of 
P+, described as follows. Let B denote the tangential symmetric elliptic differential 
operator over E in the product form 

v+ = a{du + B) ■.C’^ {N, S+\N) ^ C°° {N, S~\N) 

in a collar neighborhood A/^ of E in X. It has discrete real eigenvalues and a 
complete system of orthonormal eigensections. Let P>{B) denote the spec- 
tral (Atiyah-Patodi-Singer) projection onto the subspace L^{B) of I/^(E;5+|s) 
spanned by the eigensections corresponding to the nonnegative eigenvalues of B. 
It is a pseudo-differential operator and its principal symbol is the projection 
onto the eigenspaces of the principal symbol 6(y, () of B corresponding to nonneg- 
ative eigenvalues. It turns out that coincides with the principal symbol of the 
Calderon projection. 

We call the space of pseudo-differential projections with the same principal 
symbol the Grassmannian and equip it with the operator norm cor- 

responding to L^(E;5 +|e). It has countably many connected components; two 
projections Fi, P 2 belong to the same component, if and only if the virtual codi- 
mension 

(2.31) i{P 2 ,Pi) := index {P 2 F 1 : range Pi ^ range P 2 } 

of P 2 in Pi vanishes; the higher homotopy groups of each connected component 
are given by Bott periodicity. 

Example 2.24 a. For the Cauchy- Riemann operator d on the unit disc = 
{1^1 < 1}, the Cauchy data space is spanned by the eigenfunctions of the tan- 
gential operator de over = [0, 27t]/{0, 27t} for nonnegative k. So, the Calderon 
projection and the Atiyah-Patodi-Singer projection coincide in this csise. 

Example 2.24 b. We now consider the cylinder — [0, R] x Eq with Vr = 
a{du + P). Here B denotes a symmetric elliptic differential operator of first order 



[0,i?]xSo 




Figure 8. Cylinder of length R 



acting on sections of a bundle E over Eq , and a a unitary bundle endomorphism 
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with = —I and aB = —Ba. Let B be invertible (for the ease of presentation). 
Let Aa:} denote the B^s spectral resolution of L^(Eo; E) with 



• • • < A_fc < • • < A_i < 0 < Ai < • • • < Afc < • • • 



Then 

(2.32) 

We consider 



Bifk = \k^k for all A; G Z \ {0}, 

X-k = -Xk , cr{(fk) = and a{(f-k) 



—(fk for k > 0. 



f £ Ker{T>R,0) = span{e ^'‘“<Pfc}fcez\{o} in 

= Kerl>i?max (kernel of maximal extension) 



It can be written in the form 



(2.33) f{u,y) = f>{u,y) + f<{u,y), u6[0,fl], 

where 

f<{u,y) = ’^ake~^‘‘^ipk{y) and f>{u,y) = '^ake~^’^'^(pk{y)- 

k<0 k>0 

Because of 



(/>/)l 2 (xR) < +00 (/<./<) < +00 and (/>,/>) < +oo, 

the coefficients ak satisfy the conditions 



(2.34) 

k<0 

and 

(2.35) 



g— 2AfcR _ ^ 

2|Afc| 

I _ g-2AfcR 

2Xk 



< oo 



or, equivalently, E 



k<0 



o 2 |Afc|R 

I VI 



< (X), 



. 1 . ^Wk\^ 

< oo or, equivalently, > — — < oo. 

Xk 



fc >0 fc >0 

We consider the space A{Vfi,0) consisting of all y(/) with / G Ker(D/^,0). Here 
7(/) denotes the trace of / at the boundary 

E = dX^ = -Eo U Eh, 



where T,r denotes a second copy of Eq . According to the spectral splitting (2.33), 
we have 

7(/) = (s<>«<) + (4>«>). 

where 

s°>=/>(0), 4=/<(0)- s^ = MR), s« = /<(i?). 

Because of (2.34) and (2.35), we have 

(s°,s5) gC°°(EoUEh) and {sl,s^) £ 

Recall that 
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and |Afcl ~ \k\ for k — > =boo, where m — 1 denotes the dimension of Sq. 

One notices that the estimate (2.34) for the coefficients of is stronger than 
the assertion that ^ ^ natural N. Thus our estimates 

confirm that not every smooth section can appear ais initial value over Sg of a 
solution of Vjif = 0 over the cylinder. 

To sum up the example, the Cauchy data space A(T>i^, 0) can be written as the 
graph of an unbounded, densely defined, closed operator T : DomT ^ 
mapping := with DomT C To ob- 

tain a closed subspace of T^(S), one takes the range A{Vr^ of the extension 
of the Calderon projection. It coincides with A{Vr, O)nT^(E) by Propo- 
sition 2.23. In Theorem 2.31 we show without use of the pseudo-differential calculus 
why the intersection A(Vr, 0) H T^(E) must be closed in T^(E). See [ScWoOO, p. 
1214] for another description of the Cauchy data space A(Vr, ^), namely as the 
graph of a unitary elliptic pseudo-differential operator of order 0. 

Since E = —Eg U T>r , the tangential operator takes the form B = B ^ i~^)^ 
and we obtain from (2.32) 



range = L+{B) = spa.ni^ 2 ^^^{{(pk,(r{(pk))}k>o ■ 

For comparison, we have in this example 

rangeP(Pij)(°) = A{Vr, \) = spani,2(s){(iy3fc, , 

hence Lj^{B) and A{Vr^ ^) are transversal subspaces of L‘^{T>). On the semi-infinite 
cylinder [0,cxd) x E, however, we have only one boundary component Eg . Hence 

rangeP>(B)(°) = spanj^2(S(,){<y3fc}fc>o = ^1^ range 



One can generalize the preceding example: For any smooth compact manifold 
X with boundary E and any real -R > 0, let denote the stretched manifold 

:= ([-P,0] X E)UsX 

Assuming product structures with V = (j{du + B) near E gives a well-defined 
extension Vr of V. Nicolaescu proved in [Ni95] that the Calderon projection and 
the Atiyah-Patodi-Singer projection coincide up to a finite-dimensional component 
in the adiabatic limit {R +oo in a suitable setting). Even for finite R and, in 
particular for R == 0, one has the following interesting result. It was first proved 
by Scott [Sco95] (see also Grubb [Gr99] and the Appendix by Wojciechowski in 
[DaKi99], who both offered different proofs). 

Lemma 2.25. For all R > 0, the difference V{T)r) — P>{B) is an operator with 
a smooth kernel. 
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2.3.7. Twisted orthogonality of Cauchy data spaces. Green’s formula (in par- 
ticular the Clifford multiplication a in the case of Dirac type operators) provides 
a symplectic structure for L^(E;5|s) for linear symmetric elliptic differential op- 
erators of first order on a compact smooth manifold X with boundary E. For 
elliptic systems of second-order differential equations, various interesting results 
have been obtained in the 1970s by exploiting the symplectic structure of corre- 
sponding spaces (see e.g. [LaSnTu75]). Restricting oneself to first-order systems, 
the geometry becomes very clear and it turns out that the Cauchy data space 
A(P, is a Lagrangian subspace of L^(E; S'js)- 

More generally, in [BoWo93] we described the orthogonal complement of the 
Cauchy data space of the chiral Dirac operator by 

(2.36) a-i(A(2?-,i)) = (A(I3+,i))^. 

We obtained a short exact sequence 

0^(t-1(A(I?-,s)) Ker(2?+,s) ^0. 

For the total (symmetric) Dirac operator this means: 

Proposition 2.26. The Cauchy data space A(P, of the total Dirac oper- 
ator is a Lagrangian subspace of the Hilbert space L^(E;6'|s) equipped with the 
symplectic form 'ip) := (<J(p, ip). 

2.3.8. “Admissible” boundary value problems. We refer to [BoWo93, Chap. 
18], [BrLeOl], and [ScOl], for a rigorous definition and treatment of large classes 
of admissible boundary value problems defined by pseudo-differential projections. 
Prominent examples belong to the Grassmannian (introduced above in Sec- 
tion 2.3.6). On even-dimensional manifolds, other prominent examples are local 
chiral projections and unitary modifications as explained in [BoWo93, p. 273]. 

For all admissible boundary conditions defined by a pseudo-differential projec- 
tion R over E, the following features are common: (For simplicity, we suppress the 
distinction between total and chiral spinor bundle in this paragraph, and denote 
the bundle by E) 

(i) For / G H^{X;E) we have an estimate 

||/|li<C(||2?+/||o + ll/llo + P°*°7(/)lli). 

(ii) Defining a domain by 

D = Dom(P+) := {/ G W (X; E) \ R (/|e) = 0} , 

we obtain a closed Fredholm extension. 

(iii) The restriction of Dom(T>J) to the boundary makes a Fredholm pair with 
the Cauchy data space of D+. 

(iv) The composition RW^ defines a Fredholm operator from the Cauchy 
data space to the range of R (see also Theorem 2.20). 

(v) The space Ker {D^) consists only of smooth sections. 
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Warning: A new feature of operators of Dirac type on manifolds with boundary 
is that the index of admissible boundary value problems can jump under continuous 
or even smooth deformation of the coefficients. For instance, this is the case for 
the Atiyah-Patodi-Singer boundary problem, as follows from the next subsection. 

A total compatible (and so symmetric) Dirac operator V and an orthogonal ad- 
missible projection R define a self-adjoint extension Pj = if the projection 

R defines the domain D and satisfies the symmetry condition I — R = a~^Rcr. We 
denote by ^r®^ or, shortly, the subspace of Qrp_^ of orthogonal projections 
which satisfy the preceding condition and differ from the Atiyah-Patodi-Singer 
projection only by an infinitely smoothing operator. 

Posing a suitable well-posed boundary value problem provides for a nicely 
spaced discrete spectrum near 0. Then, varying the coefficients of the differential 
operator and the imposed boundary condition suggests the use of the powerful 
topological concept of spectral flow. From (i) and a careful analysis of the corre- 
sponding parametrices, we see in [BoLePhOl, Section 3] under which conditions 
the curves of the induced self-adjoint extensions become continuous curves in 
E)) in the gap topology so that their spectral flow is well-defined and 
truly homotopy invariant. 

We summarize the main results. They depend strongly on the weak unique 
continuation property (either in the form of Section 1.4 or in the weaker form of 
(1.6) which is sufficient here) and the invertible extension (Section 2.3.4). 

Lemma 2.27. For fixed V the mapping 

(V)BP^Vpe E)) 

is continuous from the operator norm to the gap metric. 

Theorem 2.28. Let X he a compact Riemannian manifold with boundary. Let 
{'Ds}seM^ ^ ^ metric space, he a family of compatible operators of Dirac type. We 
assume that in each local chart, the coefficients ofVg depend continuously on s. 
Then we have: 

(a) The Poisson operator Kg : L^(E;F^|^) ^ H^^‘^{X\E) ofVg depends continu- 
ously on s in the operator norm. 

(b) The Calderon projector P^{s) : L^(S;E'|x:) — > I/^(S;£'|x:) ofVg depends con- 
tinuously on s in the operator norm. 

(c) The family 

MBs^ (A)p+(.) € Cr^{L\X- E)) 

is continuous. 

(d) Let Pt {tev} ^ norm- continuous path of orthogonal projections in LP‘{X\ E). 

If 

-Pi € Pi for every t e Y, 

s^M 

then 

MxYB{s,t)^ {Vs)p, e CJ^^{L^{X-,E)) 



is continuous. 




62 



DAVID BLEECKER AND BERNHELM BOOSS-BAVNBEK 



Note that (b) is a pseudo-differential reformulation of the continuity of Cauchy 
data spaces which is valid in much greater generality (see our Section 1.2.2). 

We close this section with a recent result of [Gr02]: 

Lemma 2.29 (G. Grubb 2002). Let V be an operator of Dirac type over a com- 
pact manifold with boundary. Let P be an orthogonal projection which defines an 
^admissible’ self-adjoint boundary condition for V . Then there exists an invertible 
operator of Dirac type 8' over the boundary such that P = P^{8'). 

Grubb’s Lemma shows that the Atiyah-Patodi-Singer boundary projection is 
the most general admissible self-adjoint boundary condition, in the specified sense. 

2.4. The Atiyah-Patodi-Singer index theorem. Let X be a compact, 
oriented Riemannian manifold with boundary Y — dX with dimX = n = 2m 
even. Let V : (X, S) — > (X, S) be a compatible operator of Dirac type 

where 5 X is a bundle of Clifford modules. Relative to the splitting S — 

into chiral halves, we have the operators (X, S~^) (X, S~) 

and D~ : (X, S~) (X, S~^) which are formal adjoints on sections with 

support in X\y. We assume that all structures (e.g., Riemannian metric, Clifford 
module, connection) are products on some collared neighborhood X = [— 1, 1] x X 
of y. Then V-^\n := (X, 5+|X) ^ (X, S~\N) has the form 

V+\N=a(du + B). 

Here u G [—1, 1] is the normal coordinate (i.e., X = {{u,y) | y G X, u G [—1, 1]}) 
with du = ^ the inward normal), a = c{du) is the (unitary) Clifford multiplica- 
tion by du with cr(S'“^|X) = 5“|X, and 

c^(y,5+|y) ^c^(y,*s+|r) 

denotes the canonically associated (elliptic, self-adjoint) Dirac operator over T, 
called the tangential operator. Note that due to the product structure, a and 
B do not depend on u. Let P>{8) denote the spectral (Atiyah-Patodi-Singer) 
projection onto the subspace Lj^{8) of L^(y, spanned by the eigensections 

corresponding to the nonnegative eigenvalues of B. Let 

C°°{X,S+-P>) := € C°°(X,5+) I P>{B){^\y) = 0} , 

V+^_ ■.= V+\coo(x,s^,p^_y.C^{X,S+-,P>)^C°°{X,S-). 

The eta function for B is defined by 

Vb{s):= ^ (signA)mA |A|“% 

AGspec {0} 

for 5R(s) sufficiently large, where m\ is the multiplicity of A. Implicit in the fol- 
lowing result (originating in [AtPaSi75]) is that extends to a meromorphic 
function on all C, which is holomorphic at s = 0 so that t]b (0) is finite. 
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Theorem 2.30 (Atiyah-Patodi-Singer index formula). The operator has 
a finite index given by 

index = j ^ch(5, s) A A{X, 6)^ - i (mo + r?B(0)) , 

where mo = dim (Ker , ch (5, e) G Q* {X, R) is the total Chern character form of 
the complex vector bundle S with compatible, unitary connection e, and A (A, 6) G 
Q*(A, M) is closely related to the total A{X,6) form relative to the Levi-Civita 
connection 6, namely A (A, = 2^^“^A (A, 0)^^. 

Proof, (outline) The proof found in [AtPaSi75] or [BoWo93] is based on 
the heat kernel method for computing the index, but the process is less straightfor- 
ward than in the closed case because of the boundary condition. The appropriate 
heat kernel is constructed by means of Duhamel’s method. Namely, an exact kernel 
is obtained from an approximate one by an iterative process initiated by writing 
the error as the integral of a derivative of the convolution of the true and approx- 
imate kernel; see (2.46) below. The initial approximate heat kernel is obtained by 
patching together two heat kernels, denoted by Ec and Ed- Here, Ec is a heat kernel 
for a Dirac operator over an infinite extension [0, oo) x F of the collared neighbor- 
hood A = [0, 1] X y of y in A, for which the boundary condition P>{B) (^|y) = 0 
is imposed. The heat kernel Ed is the usual one (without boundary conditions) for 
g-tp p+^ where T)^ are chiral halves of the invertible Dirac operator (see (2.29)), 
namely 

^ :=V^UV^ : C^(A,^) ->C°^(A,5±) 

over the double A, a closed manifold without boundary. 

We begin with the construction of Ec- We let 

D:=du+B: C^{N, 5+|A) ^ C^(A, 5+| A), 
which has formal adjoint D* —du + B. Define 

V:=D\BomV and P* = D*|DomP*, 



where 



Doml? := {/ G W{R+ x r,7T*(5+|y)) | P>(/|{o}xy) = 0}, 
DomP* := {/ € X r,7r*(5-|y)) | F<(/|{o}xy) = 0}. 

We also have the Laplacians given by 

Ac := V*V\ DomP*P and VV*\BomVV% 



where 



DomV*V := {/ € DomP | P<(P/|{o}xy) = 0}, 
DomPP* := {/ G DomP* | P>(P*/I{o}xy) = 0}. 
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Let <-p\{y) G S~^\Y) be an eigensection of B with eigenvalue A G M. Note 

that gx{t;u,y) — f\{t,u)(px{y) is a solution of the heat equation 

0 = (5t + Ac)g\ = dtgx + + B){-du + B)gx = (St - + B‘^)gx 

= {dtfx - dlfx + ^^fx)>Px{y), 

with gx{i\ *, •) ^ DomD*r>, when fx : (0, oo) x [0, oo) ^ R solves the heat problem 
dtfx = ^ufx — with boundary conditions 

(2.37) fx{t,0)=0 if A>0, 

dufx{t,0) + Xfx{t,0) ^ Dfx = 0 ifA<0. 



Recall that the complementary error function is 

9 

erfc(x) := -y= / e~^ d^. 

V ^ J X 



Of use to us are the facts 



-2 



(2.38) 



erfc'(a:) = —j=e ^ 1 and 
\/7r 

o 

erfc(x) < 






For A > 0, the heat kernel for the problem (2.37) is (via the method of images) 



< e ^ for X > 0. 



ex{t]u,v) 



e ^ ^ f 

: e 4t 






for u, u > 0 and ^ > 0. 



2y/7rt V 

For A < 0, > 0, and t > 0, the heat kernel is (using Laplace transforms) 

2 \/^ 

The heat kernel for Ac (i.e., the kernel for is then 



ex{t\ u, v) i~^ (e ^ -I- e *^44^ _l_ erfc , 



(2.39) £c{t;u,y\v,z) = ^ex{t;u,v)(px{y) <S> ipxiz)* 

A 

Here A ranges over spec^B and (by a convenient abuse of notation) (px{y) ^ ^x(^)* 
is really a sum X]/c^A,fe(y) ^ ^x,k(^)* where • • • ,^x,kj is an orthonormal 

eigenbasis of the eigenspace for A, and {ip\ i, • • • 5 /J basis. Similarly, 

the heat kernel for Ac* is 



(2.40) Sc*{t-,u,y;v,z) = ^ex*{t;u,v)ipx{y) ^ (px{z)* , 

X 

where ex* is the heat kernel for the problem 

dtfx = S^/a — A^/a with boundary conditions 
/A(t,0) =0 if A<0, 

S./A(t,0) - Xfx{t,0) = D*fx = 0 if A > 0, 



(2.41) 
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where f\ : (0, oo) x [0, oo) — ^ R. Thus, for u,v >0 and i > 0, we have 



ca* {t; u,v) \= — -j= ( e - e 4^ ) for A < 0, 

2\f7rt ^ ' 

while for A > 0 (note the change of sign in passing from (2.37) to (2.41)), 
eu{t;u,v) := + e“' _ Ae^(“+“Trfc (|^ + Av^)^ 

Combining (2.39) and (2.40), we obtain the trace of the kernel Sc — Sc^ for the 
difference evaluated at the point {u, y\ u, y) of the diagonal: 

IC{t;u,y) := Tr^(eA(t;w,u) -- e^x{t-,u,u))(px{y) <P*\{y) 



=e + Ae2^“erfc(^ +A%/i)^|(pA(2/)P 






X^sign(A) 



-X^t„ — u^jt 



+ |A|e2|^l“erfc(^ + |A|v/i)) |<^a(j/)| 



^sign(A)^(ie2|^l“erfc + |A|Vi)) |</ja(j/)P- 



We used erfc^(x) = to obtain the last equality, and we have set sign(O) := 1 

for convenience. We compute (where the interchange of the sum and integral can 
be justified) 



IC{t) := / IC{t;u,y)dydu 

Jo Jy 

V- . ... d ^ 



= y^5Z^^Sn(A) — (^|e2|^l^erfc(^ + \X\Vi)^\^x{y)\^dydu 

= ^TOAsign(A)^ ^(^ie2l^l“erfc(^ + |A|v^))du 
= y^mAsign(A)(^ie^l^l“erfc(^ + 



= - x^A sign(A) erfc (|A| V^) 

A 

= - - y] ^rriA sign(A) erfc (1 A| \/f) . 

At^O 
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Recall that m\ is the multiplicity of A. Thus, 

/C(t) + |mo = - ^m\ sign(A) erfc(lA|\/t). 






For |A| >0, one verifies using integration by parts and substitution that 

|A|-2» 



pOO 

/ erfc(|A|\/t) 

Jo 



dt — 



50r 



■r(s + i). 



Using this and the fact that JC{t) < Ce for constants C and o; > 0, 
= - f f sign(A)erfc(|A|\/t))t^~Mt 

•'0 ^ A^O ^ 

= — ^ -ruA sign(A) / erfc(|A|\/t) t^~^dt 

Jo 



\:^0 



= ~ + 5) 

A/0 ^ 



I— 2s 



,£(i+i) 

2Sy/7T 



A^O 
Vb{2s). 



Suppose that we have an asymptotic expansion 

N 

m- E as t -> 0+; i.e., 

k=—n+l 

N 

K{t)~ E = O as t ^ 0+. 

k=—n+l 

In (2.53) below, such an asymptotic expansion will eventually be produced (as was 
done in [BoWo93, p. 239f|) from the known asymptotic expansion (see [Gi95, 
p. 68]) of the heat kernel on a closed manifold, namely the double of M. Since 

2 2 



^{s) > implies + s — 1) > — 1, we then have that 



fi{s) J (^JC{t) — ^ ^dt = j O (t ^ ^)ds 

is holomorphic for 9f^(s) > — We also have the entire function 



/oo(s) := ^dt 
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We claim that 

ns+h) 

2Sy/7T 
Indeed, we have 

-tjb{2s) 



^%(2s)-^+ {jf^)+Ms) + foo{s). 

k— — n-\-l ^ 



+ k) 

2 Sy/ 7 T 



— J ^dt — J ^dt + foo{s) 

pi N 

= (^^mo+ ^ + /i(s) + /oo(s) 

^ k=—n+l 

nl N „1 

= / \mot^~^dt+ V) «fc / + /i(s) + /oo(s) 

^0 k=-n+X ^0 



1 

= Irno — 



k—-n-\-l 
it=l N 



■‘■I ty 1 

XI +/i(-^) +/oo(5) 



mo 

2s 



t—O 
N 






fc=— n+1 



Thus, where 0n{s) = fi{s) + foo{s) is holomorphic for 9^(s) > — 

(.4.) = f 

^ ^ k— — n->rl ^ 

The heat kernels, say Sd for V~V^ and 8d* for P+P~, over the double X are 
more familiar. For t > 0, 



Tr e 



-W-V+ 



— Tr e 



-tv+v- 



■■ lTT{Sd{t;x,x)-Sd^{t;x,x))dx, 
Jx 



and there is the asymptotic expansion 

F{t;x) —^^{Sdit-^x^x) - Sd*{t\x,x)) ^ ak{x)t’"/‘^. 



k>—r 



For 0 < a < 6 < 1, let p(a,b) • [0? 1] ^ [0? 1] bo and increasing with 



P(a,b) ('^) 



0 for < a, 

1 for u > 6. 



Thinking of it as the normal coordinate function on = [0, 1] x T C X, and 
extending by the constant values 0 and 1, we can (and do) regard P(«,6) ^ a 
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function on X. Let 

Q(t; X, x') := (fc{x) Sc{t; x, x') 'ipdx') + (pd{x) Sd{t; x, x') 'ipd(x') 

•= (l - P(5/7,6/7)(x)) ^c(ijX,x')(l - P(3/7,4/7)(^')) 

+ P(l/7,2/7)(x) ^d(t; X, x') P(3/7^4/7)(x'). 

We have that + '^d = 1 and {i(^c,'^d} is a partition of unity for the cover 
oo), n~^[0, |)} of X. Moreover, for j = 

(2.43) ipj\s\xpp'iljj = 1 and dist (supp^^^^j, supp^^) > y (for k>l). 

Of course, we do not expect Q{t;x^x') to equal the exact kernel for dt + 
throughout X. However, note that for x, x' G [0, 1/7) x y, Q(t; x, x') = Sc{t; x, x'), 
so that Q{t;x^x') meets the APS boundary condition. 

Let x' G A be fixed. For x G A \ [0, 6/7) x P, we have 

Q(t;x,x') = Sd{t;x,x')'il;d{x'), 

while for x G [0, 1/7) x F, 

Q(t;x,x') = Sc{t;x,x')i)c{x'). 

Thus, for X G A \ ([y, |] x F), —{dt + TXV)Q{'\ '^x')\(^f,x,x>) = 0- Moreover, for 
d(x,x') < 1/7, 

(Pcix)tpcix') + (pd{x)'ipd{x') 

— d - P(5/7,6/7)(^))(l - P(3/7,4/7)(^0) + P(l/7,2/7) (^)P(3/7,4/7) (^0 
= 1 ~ P(5/7,6/7)(^) “ P(3/7,4/7)(^0 

+ P(5/7,6/7)(^)P(3/7,4/7)(^0 + P(l/7,2/7) (^)P(3/7,4/7) (^0 
= 1 “ P(b/7,6/7){x) - P(3/7,4/7)(^0 + P(5/7,6/7) (^) + P(3/7,4/7) (^0 
= 1 . 

Note that d(x,x') < 1/7 implies P(5/7,6/7)(^)P(3/7,4/7)(^') = P(5/7,6/7)(^), and 
P(]/7,2/7)(^)P(3/7,4/7)(^0 “ P(3/7,4/7) (^)- Because of this, we expect that 

lim <3(^;x,x') == lim ((pc{x)Sc{t]x,x')^c{x')-\-(pd{x)Sd{t;x,x')'il;d{x')] 
t-^o+ t->o+ V / 

= (fc{x)S{x,x')iljc{x') (pd{x)S{x,x')dd{x') 

= {(fc{x)'ilJc{x') + ipd{x)'ipd{x'))S{x,x') 

— (5(x, x'). 

Thus, on the operator level, we expect that limt^o+ Qt — i-^-, 

lim Qt{f){x) — lim [ Q{t;x,x')f{x')dx'= [ J(x, x')/(x') dx' = /(x). 
t^0+ t^0+ Jx Jx 

The extent to which Q{’;',x') fails to satisfy the heat equation in [y, f] x F is 
given by 



C{t; X, x') := -(a, + P*P) g(.; •, xO|(t;.,xq. 
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For x' G X fixed and x = (u,y) ^ N = [0, 1] x F, we have 
-C{t; X, x') = {dt + V*T>) Q{t; x, x') 



(2.44) 



= {dt + V*V) ( ^ <pj{x)ej{t; X, x')i>j{x') j 

je{c,d} 

je{c,d} 

+ 2du{^j{x)) duSj{t\x,x')'iljj{x'). 



For d{x,x’) < y, we have (7(t; x, x') = 0, since (2.43) implies that ^c(^0 — ^ when 
(a;)) / 0 and d{x,x') < j. Using this and the estimates 

£j{t;x,x') < 
du£j{t;x,x') < 



for positive constants A and B, it follows from (2.44) that 
\C{t-,x,x')\ < 



(2.45) 






for 0 < t < To < oo, and positive constants c\ and C 2 - 

Let S{t]x,x') be the exact heat kernel for T*P and let the corresponding 
operator be 8{t) = exp{—W*V). On the operator level, we have 



(2.46) 



£(t) - Q{t) = S{t)Q{0) - £{0)Q{t) 



= / ■^{£{s)Q{t - s))ds 

= [ -Q{t-s)+£{s)-^Q{t-s)ds 
Jq ds cLs 

rt 7 

= / -V*V£{s)Q(t~s)+£{s)—Q{t 
Jo ds 

= [ S{s)C{t-s)ds. 

Jo 



— s) ds 
ds 



Hence on the kernel level, 



S{t;x,x^) = Q{t;x,x') + / / S{s;x, z)C{t — s] z,x') dzds 

Jo Jx 

= Q{t; X, x') H- (^ * C)(t; x, x'), 



(2.47) 
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where the convolution operation is defined by 

{a ^ P){t;x,x') := / / a{s\x, z)p{t — s; z,x')dzds. 

Jo Jx 

Note that (2.47) can be written as 



Thus, at least formally, 



£ = Q[I- *C{t))-^ = Q{I + ^(*C)'') 
(2.48) ^ 

— Q Q * 'y ) Ck = Q + Q * C, 

k=l 



where 



Cl := C- = -{dt + V*V)Q, Ck+i := Ci ♦ Ck, and C 

k^l 

The proof of the validity of the Levi sum (2.48) for S rests on the estimate (2.45) 
and we refer to [BoWo93, Chap. 22] for the details. The above constructions can 
be also be applied to obtain a kernel S^{t;x,x') for exp(— tPP*) starting from 

Q^{t;x,x') := cpc{x)Sc*it; x,x')'ipc{oc') + (pd{x)Sd*{t;x,x')'ipd{^')- 

Recall that for {u,y) G [0, oc) x Y, 



(2.49) 



JC{t; % y) \= Tr(£:c(t; (u, y), (u, y)) {t-,{u,y),{u,y))), and 



m 




/C(t; u^y) dydu. 



For X e X, let 

F{t;x) := Tr{Sd{t;x,x) - Sd^{t;x,x)). 



Now, 

index = Tr = Ti{£{t) - 

We use the following notation for functions being “exponentially close” as t 



0 + : 



(2.50) f{t) ~exp g{t) \f{t) - g{t)\ < ae for t £ (0,£) 

for some positive constants a, 5, and e. We claim (but must omit important details 
here see [BoWo93, Chap. 22]) that 

Tr(£:(^) - '-^exp Tr(Q(t) - 




SPECTRAL INVARIANTS AND PARTITIONED MANIFOLDS 



71 



Since £ = Q Q ^ C (resp., £^ = ^ C^), this result ultimately rests on 

(2.45) (resp., the corresponding result for C*). Since and (fd'4^d = 

Tr{Q{t) - Q^{t)) = I Tr [Q{t;x,x) - Q^{t]x,x)) dx 

Jx 

= J Tt (^<Pc(x){£c - Sc*){t;x,x)ipc{x) 

+ <Pd(x){£d - £d*){t\x,x)tpci{x)^ dx 

= K{t\u,y)tpc{u) dydu + / F {£, x)ipd{x) dx . 

Jo Jy Jx 



Let 



Note that 






.{t) - [ [ IC{t;u,y)dydy 
Jo Jy 



lC{t)-ICa{t) = a K{t\ y) dydu 

= ^mAsign(A)(|e^l^l“erfc + |A|v7)^ | 

= y^mAsign(A) e^l^l“erfc + |A|A/i). 

A 

Thus (using (2.38)) for some constant c > 0 

\IC{t) - ICait)\ < ^ mAe^l-^l“ exp (^ - (^ + |A|\/t)^^ 






mxe 



-|Ap( 






(2.51) 



which says that IC{t) '-^exp Hence, 

index = Tr {£{t) - £*{t)) ~exp Tr (Q{t) - Q,(i)) 

= K,{t-,u,y)ipc{u)dydu+ / F{t\x)il}d{x) dx 

Jo Jy Jx 

'^exp (fX K{t\u,y) dydu J F{t;x)'ipd{x) dx^ 

= /C(t) + / F{t]x)dx. 

Jx 

The last equality follows from (2.49) and the fact that 
(2.52) F{t;x) = Tv{£d{t;x,x) - £d^{t;x,x)) = 0 
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for X G TV = [0, 1] X y, which is seen as follows. Since a* = — cr, 



V^N= (y{du + B) : C^(7V,5+) ^ C^{N,S-) implies 
^\n = + B)Y = {du - B)g : C^{N,S^) ^ C^{N, ^), 

Thus, over N, 

= {du - B)aa{du + B) = {~dl + B‘^)\C^{N,S+), 

= a{du + B){du - B)a = a‘^{du - B){du + B) 

= (-a^ + B 2 )|C 7 -(Ar,^). 



Since [(— a] = 0 , (t maps the eigenspaces of V~V+ pointwise isometrically 
(over N) onto those of T>+X>~. Hence, we obtain (2.52) upon taking the trace of 
the eigensection expansion of Sd{t]x,x) — Sd*{t;x,x) for x e N. From (2.51), we 
obtain 



(2.53) 



/C(t) = index Pj — 




dx 



r\j index Pp^ 



L 



ak{x)t^^^ dx 

k>—n 



= index Pp^ — E Ak dx 

k>—n 



for Ak := / ctk{x), where F{t]x) ~ 5Zfc>-n asymptotic expan- 

Jx ~ __ 

sion of the trace F{t; x) of the kernel for ^ which is known for 

elliptic differential operators (e.g., P~P+ and P+P~) over closed manifolds such 
as X (see [Gi95, p. 68 ]). Thus, according to (2.42) with = —Ak for k ^ 0, and 
ao = index Pp^ — ^o, we get 



775 ( 2 s) 



2s\/7t /mo 






k= — n~}-l 2 



2 s\/^ /mo 1 



;indexl>+^- E (l^)+^^(^))- 



k=-n+l ' 2 ^ + ®' 



Setting s = 0 yields rjjs(O) = —(mo + 2 index Pp^ — 2 Aq), or 
index P+^ = Aq - ^(mo -h m(Q)). 



□ 
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2.5. Symplectic geometry of Cauchy data spaces. As we have seen in 
our Section 1.2.2 there exists a concept of Cauchy data spaces which solely is based 
on the concepts of minimal and maximal domain and which is more elementary 
and more general than the definitions provided in Section 2.3.5 which are based 
on pseudo-differential calculus. 

In this section we stay in the real category and do not assume product structure 
near E = dX unless otherwise stated. The operator V need not be of Dirac type. 
We only assume that it is a linear, elliptic, symmetric, differential operator of first 
order. 

2.5.1. The natural Cauchy data space. Let 2>o denote the restriction of V to 
the space C^{X\S) of smooth sections with support in the interior of X. As 
mentioned above, there is no natural choice of the order of the Sobolev spaces 
for the boundary reduction. Therefore, a systematic treatment of the boundary 
reduction may begin with the minimal closed extension Pmin •= and the adjoint 
T^max (T^o)* of T)q. Clearly, Pmax is the maximal closed extension. This gives 

:= Dom(D™„) = C^{X-sf = Cg^iX; 

and 

Dmax ■■ = Dom(r> max) 

— {u e L^(X; S) I Vu e L?{X\ S) in the sense of distributions}. 

Here, the superscript Q means the closure in the graph norm which coincides with 
the first Sobolev norm on {X ; S) . We form the space (3 of natural boundary 
values with the natural trace map 7 as described in Section 1 . 2 . 

There we defined also the natural Cauchy data space A(V) := 7 (KerDniax) 
under the assumption that V has a self-adjoint extension with a compact 
resolvent. Such an extension always exists. Take for instance the operator 

T> with domain 

Domp(i,) :={f eH\X-S)\V{V)^i'>{fh)=0}, 

where V{T>) denotes the Calderon projection defined in (2.30). 

Clearly, Dmax and Dmin are C^{X) modules, and so the space is a C°°(E) 
module. This shows that (3 is local in the following sense: If E decomposes into r 
connected components E = Ei U • • • U E^ , then (3 decomposes into 

r 

j=i 

where 

-Dm ax I supp/ C Nj]) 

with a suitable collared neighborhood Nj of Ej . Note that each (3j is a closed 
symplectic subspace of (3 and therefore a symplectic Hilbert space. 
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By Theorem 2.20a and, alternatively and in greater generality by Hdrmander 
[Ho66] (Theorem 2.2.1 and the Estimate (2.2.8), p. 194), the space P is natu- 
rally embedded in the distribution space 77“ 2 (E; S\^). Under this embedding we 
have A(D) = A(P, 0), where the last space was defined in Definition 2.22. 

If the metrics are product close to E, we can give a more precise description 
of the embedding of /7, namely as a graded space of distributions. Let {(p/e. A/e} be 
a spectral resolution of L^(E) by eigensections of B. (Here and in the following we 
do not mention the bundle S). Once again, for simplicity, we assume KerB — {0} 
and have B(pk = for all /c G Z \ {0}, and X-k = —Xk , cr{(pk) = <f~k ? and 

a{(f-k) = —^k for A: > 0. In [BoFu99, Proposition 7.15] (see also [BrLeOl] for a 
more general setting), it was shown that 



^ = /3_ 0 /7+ with 

T -F =rH-i(E) 

(2.54) := [{v?fc}fc<o] and /?+ := [{¥>fe}fc>o] 

Then, /7_ and are Lagrangian and transversal subspaces of p. 

2.5.2. Criss-cross reduction. Let us define two Lagrangian and transversal 
subspaces L± of L^(E) in a similar way, namely by the closure in L^(E) of the 
linear span of the eigensections with negative, resp. with positive eigenvalue. Then 
L+ is dense in /3_i_ , and P- is dense in I/_ . This anti-symmetric relation may 
explain some of the well-observed delicacies of dealing with spectral invariants of 
continuous families of Dirac operators. 

Moreover, 7 (Daps) = P-^ where 

(2.55) Daps := {/ e H\X) \ P>(/|e) = 0} 

denotes the domain corresponding to the Atiyah-Patodi- Singer boundary condi- 
tion. Note that a series converge to an element G L^(E) with- 

out converging in 77^ (E). Therefore such G L_ can not appear as trace at the 
boundary of any / G Dmax- 

Recall Proposition 1.27 and note that (/7_, A(7>)) is a Fredholm pair. 

This can all be achieved without the symbolic calculus of pseudo-differential 
operators. Therefore one may ask how the preceding approach to Cauchy data 
spaces and boundary value problems via the maximal domain and our symplectic 
space p is related to the approach via the Calderon projection, which we reviewed 
in the preceding section. How can results from the distributional theory be trans- 
lated into LP results? 

To relate the two approaches we recall a fairly general symplectic ‘Criss-Cross’ 
Reduction Theorem from [BoFuOtOl, Theorem 1.2]. Let P and L be symplectic 
Hilbert spaces with symplectic forms and lol , respectively. Let 



p = p_^p^ and L = L_ -h 7/+ 
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be direct sum decompositions by transversal (not necessarily orthogonal) pairs of 
Lagrangian subspaces. We assume that there exist continuous, injective mappings 

i- \ (5- ^ L_ and 2 + : L+ ^ 

with dense images and which are compatible with the symplectic structures, i.e., 
o;l( 2-(3:), a) — 2 +(a)) for all a G I/+ and x G /3- . 

Let II G J^Cj 3 _ (/^), for instance, = (/x fl /5_) + p with a suitable closed v. Let us 
define (see also Figure 9) 

(2.56) r(/x) 2 _(/x H /?_) + graph((/?^), 

where 

> 

X i-- o fy o ij^{x). 

Here denotes the image of /x under the projection from /x to (3^ along (3- 
and fu-F^^ (3- denotes the uniquely determined bounded operator which yields 
u as its graph. Then: 

Theorem 2.31. The mapping (2.56) defines a continuous mapping 
T : FCp_{P) FCi^_{L) 

which maps the Maslov cycle Aip_ (fi) of (3- into the Maslov cycle A4 l_ {L) of L- 
and preserves the Maslov index 

mas({/iJ,g[o,i],/3_) = mas({r(/is)},e[o,i], L-) 
for any continuous curve [0, 1] 3 s /Xg G 
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In the product case, the ‘Criss-Cross’ Reduction Theorem implies for our two 
types of Cauchy data that all results proved in the theory of natural boundary 
values {P theory) remain valid in the theory. In particular, we have: 

Corollary 2.32. The T^(E) part A{V) n of the natural Cauchy data 

space A{T>) is closed in T^(5]). Actually, it is a Lagrangian subspace and 

it forms a Fredholm pair with the component L_ , defined at the beginning of this 
section. 



2.6. Non- additivity of the index. 

2.6.1. The Bojarski conjecture. The Bojarski conjecture gives a quite different 
description of the index of an elliptic operator over a closed partitioned manifold 
M = Ml Ue M2 . It relates the ‘quantum’ quantity index with a ‘classical’ quantity, 
the Fredholm intersection index of the Cauchy data spaces from both sides of the 
hypersurface E. It was suggested in [Bo79] and proved in [BoWo93] for operators 
of Dirac type. 

Proposition 2.33. Let M be a partitioned manifold as before and let A(P^, 
denote the Cauchy data spaces, j = 1,2 {see Definition 2.22). Then 
indexV^ = index (A(D^ , ^), A(T>f , |)) . 

Recall that 

index (A(P+, 5), A(X>J, i)) ;= dim {A{Df, i) n A(Dj, i)) 

- dim (l2(E; 5b)/(A(D+ i) + A(V+, i))). 

It is equal to i(/ — where V{T>^) denotes the corresponding 

Calderon projections, and i(*, •) was defined in (2.31). 

The proof of the above proposition depends on the unique continuation prop- 
erty for Dirac operators and the Lagrangian property of the Cauchy data spaces, 
more precisely the chiral twisting property (2.36). 

2.6.2. Generalizations for global boundary conditions. On a smooth compact 
manifold X with boundary E, the solution spaces Ker(T>, s) depend on the order 
s of differentiability and they are infinite-dimensional. To obtain a finite index 
one must apply suitable boundary conditions (see [BoWo93] for local and global 
boundary conditions for operators of Dirac type). In this report, we restrict our- 
selves to boundary conditions of Atiyah-Patodi-Singer type (i.e., P G Qt{V)), and 
consider the extension 

(2.57) Vp : Dom(I>p) ^ L^{X- S) 
of V defined by the domain 

(2.58) Dom(2?p) ;= {/ G W{X-, S) \ P(«)(/|e) = 0}. 

It is a closed operator in LP‘{X\ S) with finite-dimensional kernel and cokernel. We 
have an explicit formula for the adjoint operator 

(2.59) (Pp)* = Va(I-P)a^ . 
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In agreement with Proposition 1.27b, the preceding equation shows that an ex- 
tension Dp is self-adjoint, if and only if KerP^^^ is a Lagrangian subspace of the 
symplectic Hilbert space L^(H;5 '|e)- 

Let us recall the Boundary Reduction Formula for the Index of (global) el- 
liptic boundary value problems discussed in [BoWo85] (inspired by [Se69], see 
[BoWo93] for a detailed proof for Dirac operators). Like the Bojarski conjecture, 
the point of the formula is that it gives an expression for the index in terms of the 
geometry of the Cauchy data in the symplectic space of all (here L^) boundary 
data. 

Proposition 2.34. 

index Dp = index |PD (D) : A(D, ^ range(P^^^)| . 

2.6.3. Pasting formulas. We shall close this section by mentioning a slight 
modification of the Bojarski conjecture/ theorem, namely a non- additivity formula 
for the splitting of the index over partitioned manifolds. 

From the Atiyah-Singer Index Theorem (here the expression of the index on 
the closed manifold M by an integral of the index density) and the Atiyah-Patodi- 
Singer Index Theorem (Theorem 2.30), we obtain at once 

index D = index (Di)p^ -h index (D 2 )p^ — dimKer(B). 

Then an Agranovic-Dynin type correction formula (based on Proposition 2.34) 
yields: 

Theorem 2.35. Let Pj be projections belonging to Qr{Vj), j = 1,2. Then 
index D = index (Di)p^ + index (D 2 )p^ — i (P 2 , ^ ~ Pi) 

It turns out that the boundary correction term i{P 2 ^ I — Pi) equals the index 
of the operator a(dt + B) on the cylinder [0, 1] x S with the boundary conditions 
Pi 8bt t = 0 and P 2 at ^ = 1. A direct proof of Theorem 2.35 can be derived from 
Proposition 2.34 by elementary operations with the virtual indices i(Pi,P(Di)) 
and i(P 2 ,P(D 2 )); see, e.g., [DaZh96] in a more general setting. 

Remark 2.36. 

(a) In this section we have not always distinguished between the total and the 
chiral Dirac operator because all the discussed index formulas are valid in 
both cases. 

(b) Important index formulas for (global) elliptic boundary value problems for 
operators of Dirac type can also be obtained without analyzing the concept and 
the geometry of the Cauchy data spaces (see e.g. the celebrated Atiyah-Patodi- 
Singer Index Theorem 2.30 or [ScOl] for a recent survey of index formulas 
where there is no mention of the Calderon projection). The basic reason is that 
the index is an invariant represented by a local density inside the manifold plus 
a correction term which lives on the boundary and may be local or non-local 
as well. However, these formulas do not explain the simple origin of the index 
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or the spectral flow, namely that all index information is naturally coded by 
the geometry of the Cauchy data spaces. To us it seems necessary to use the 
Calderon projection in order to understand (not calculate) the index of an 
elliptic boundary problem and the reason for the locality or non-locality. 

2.7. Pasting of spectral flow. 

2.7.1. Spectral flow and the Maslov index. Let {T>t}te[o,i] t>e a continuous fam- 
ily of (from now on always total) Dirac operators with the same principal symbol 
and the same domain D. To begin with, we do not distinguish between the case 
of a closed manifold (when D is just the first Sobolev space and all operators 
are essentially self-adjoint) and the case of a manifold with boundary (when D is 
specified by the choice of a suitable boundary value condition). 

We consider the spectral flow SF {A,d} (see Section 1.1.4). We want a pasting 
formula for the spectral flow. To achieve that, one replaces the spectral flow of a 
continuous one-parameter family of self-adjoint Fredholm operators, which is a 
‘quantum’ quantity, by the Maslov index of a corresponding path of Lagrangian 
Fredholm pairs, which is a ‘quasi-classical’ quantity. The idea is due to Floer and 
was worked out subsequently by Yoshida in dimension 3, by Nicolaescu in all odd 
dimensions, and pushed further by Cappell, Lee and Miller, Daniel and Kirk, and 
many other authors. For a survey, see [BoFu98], [BoFu99], [DaKi99], [KiLeOO]. 

In this review we give two spectral flow formulas of that type. To begin with, 
we consider the case of a manifold with boundary. Then weak UCP for Dirac 
type operators (established in Section 1.4) implies weak inner UCP in the sense 
of (1.6), if the manifold is connected. Actually, it would suffice that there is no 
connected component without boundary. Let us fix the space (3 for the family. 
By Proposition 1.27c the corresponding family {A{T>t)} of natural Cauchy data 
spaces is continuous. Applying the General Boundary Reduction Formula for the 
spectral flow (Theorem 1.28) gives a family version of the Bojarski conjecture (our 
Proposition 2.33): 

Theorem 2.37. The spectral flow of the family {Vt^o} o,nd the Maslov index 
mas ({A(I>i)}, 7 (D)) are well-defined, and we have 

(2.60) SF{X?(,d} = mas ({A(P()}, 7 (D)) . 

We have various corollaries for the spectral flow on closed manifolds with fixed 
hypersurface (see [BoFu99]). Note that a partitioned manifold M = Mi Us M 2 
can be considered as a manifold M"^ = Mi U M 2 with boundary 9M^ = —SUE. 
Here U denotes taking the disjoint union. Then any elliptic operator V over M 
defines an operator over M^ with natural Fredholm extension T>^ by fixing 
the domain 

D ;= {(/i,/2) € H\Mi) X H\M2) \ (/i|s,/2|e) £ A}, 

where A denotes the diagonal of (-E; S\-z) x (E; 5|e). By elliptic regularity 
we have 

Ker V* = Ker V and SF {vfj , } = SF {A} • 




SPECTRAL INVARIANTS AND PARTITIONED MANIFOLDS 



79 



For product structures near E, one can apply Theorem 2.31 and obtain an 
version of the preceding theorem which gives a new proof and a slight generalization 
of the Yoshida-Nicolaescu Formula (for details see [BoFuOtOl, Section 3]). For 
safety reasons, we assume that T>t is a zero-order perturbation of Do, induced by 
a continuous change of the defining connection, or alternatively, Vt Vq Ct 
where Ct is a self-adjoint bundle morphism. 

Theorem 2.38. 

SF{Vt} = mas ({aJ n (-S) + A? n (E)} , a) 

=: mas ({A^ n ^^(-E)}, {A? n L^(E)}) , 
where the Cauchy data spaces Aj are taken on each side of the hypersurface E. 

Remark 2.39. Here it is not compelling to use the symplectic geometry of 
the Cauchy data spaces (see Remark 2.36b). Actually, deep gluing formulas can 
and have been obtained for the spectral fiow by coding relevant information not 
in the full infinite-dimensional Cauchy data spaces but in families of Lagrangian 
subspaces of suitable finite-dimensional symplectic spaces, like the kernel of the 
tangential operator (see [CaLeMi96] and [CaLeMiOO] ) . 

2.7.2. Correction formula for the spectral flow. Let D and D' be two domains 
between D^in and Dmax such that both {Vt^o} and become families of 

self-adjoint Fredholm operators. We assume that D and D' differ only by a finite 
dimension, more precisely, we assume 

(2.61) dim 7 (D) / ( 7 (D) D 'y(D')) = dim^{D') / ( 7 (D) fl 7 (D')) < 00 . 

Then we find from Theorem 2.37 (for details see [BoFu99, Theorem 6.5]: 

SF{Vt,D}-SF{Vt^D'} 

(2.62) = mas({A(2?t)},7(A'')) “ mas ({A (-Dt)} ,7(D)) 

= aHor {A{Vo),A(Viy,y{D')n{D)) 

(see Remark 1.26b). The assumption (2.61) is rather restrictive. The pair of do- 
mains, for instance, defined by the Atiyah-Patodi-Singer projection and the Cal- 
deron projection, may not always satisfy this condition. For the present proof, 
however, it seems indispensable. 



3. The eta invariant 

As mentioned in the introduction, a systematic functional analytical frame is 
missing for the eta invariant in contrast to the index and the spectral fiow (see, 
however, [CoMo95] for an ambitious approach to establish analogues of Sobolev 
spaces, pseudo-differential operators, and zeta and eta functions in the context 
of noncommutative spectral geometry). Basically, however, the concept of the eta 
invariant of a (total and compatible, hence self-adjoint) Dirac operator is rather an 




80 



DAVID BLEECKER AND BERNHELM BOOSS BAVNBEK 



immediate generalization of the index. Instead of measuring the chiral asymmetry 
of the zero eigenvalues we now measure the asymmetry of the whole spectrum. 

Let V be an operator of Dirac type; i.e., roughly speaking, an operator with 
a real discrete spectrum which is nicely spaced without finite accumulation points 
and with an infinite number of eigenvalues on both sides of the real line. In close 
analogy with the definition of the zeta-function for essentially positive elliptic 
operators like the Laplacian, we set 

Wis) := sign(A) A“® . 

Aespec(P)\{0} 



Clearly, the formal sum r]x>{s) is well defined for any complex number s with 
sufficiently large real part 9^(5), and it vanishes for a symmetric spectrum (i.e., if 
for each A G spec(P) also — A G spec(P)). 

In Sections 2.2 and 2.4, we expressed the index by the difference of the traces 
of two related heat operators. Similarly, we also have a heat kernel expression for 
the eta function. Let V be any self-adjoint operator with compact resolvent and 
let {Xk} denote its eigenvalues ordered so that • • • < A^-i < Xk < Xk-\-i < • • • , 
each repeated according to its multiplicity. Formally, we have 



-r j 

r ^ e dr 



(3.1) -r(^^) = y] sign(Afc)|Aft| " f 

poo 

poo poo 

= ^ Xk6~^^^^ dt= 

\ . -xn *^0 Jo 



Tre~^^ dt. 



Afc^O " 



For comparison we give the corresponding formula for the zeta function of the 
(positive) Dirac Laplacian 



(3.2) 



1 

Cx,2(s):=TV(p2)-= / 

r(s) Jo 



For the zeta function, we must assume that V has no vanishing eigenvalues (i.e. 
is positive). Otherwise the integral on the right side is divergent. (The situation, 
however, can be cured by subtracting the orthogonal projection onto the kernel of 
T>‘^ from the heat operator before taking the trace.) For the eta function, on the 
contrary, it clearly does not matter whether there are 0-eigenvalues and whether 
the summation is over all or only over the nonvanishing eigenvalues. 

The derivation of (3.1) and (3.2) is completely elementary for 9^(s) > 
and 9?(s) > , respectively, where X denotes the underlying manifold. It 

follows at once that r]{s) and C(^) admit meromorphic extensions to the whole 
complex plane. However, it is not clear at all how to characterize the operators for 
which the eta and the zeta functions have a finite value at s = 0; the eta invariant 
and the zeta invariant, respectively. 
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Historically, the eta invariant appeared for the first time in the 1970s as an 
error term showing up in the index formula for the APS spectral boundary value 
problem of a Dirac operator P on a compact manifold X with smooth boundary 
S (see our Section 2.4). More precisely, what arose was the eta invariant of the 
tangential operator (i.e., the induced Dirac operator over the closed manifold S). 
Even in that case it was hard to establish the existence and finiteness of the eta 
invariant. 

Strictly speaking, one can define the eta invariant as the constant term in the 
Laurent expansion of the eta function around the point s = 0. For various applica- 
tions this suffices. Many practical calculations, however, are much facilitated when 
we know the regularity a priori. 

Basically, there are three different approaches to establish it: The original 
proof by Atiyah, Patodi, and Singer, worked out in [BoWo93, Corollary 22.9] and 
summarized in our Section 2.4; it is based on an assumption about the existence of 
a suitable asymptotic expansion for the corresponding heat kernel on the infinite 
cylinder R+ x E. An intrinsic proof can be found in Gilkey [Gi95, Section 3.8]. It 
does not exploit that E bounds X, but requires strong topological means. 

For a compatible (!) Dirac operator over a closed manifold Bismut and Freed 
[BiPr86] have shown that the eta function is actually a holomorphic function of s 
for 5?(s) > —2. They used the heat kernel representation (3.1) which implies that 
the eta invariant, when it exists, can be expressed as 

It follows from (3.1) that the estimate 

lTrDe-*^'| < cVi 

implies the regularity of the eta function at s = 0. In fact. Bismut and Freed proved 
a sharper result, using nontrivial results from stochastic analysis. Inspired by cal- 
culations presented in Bismut and Cheeger [BiCh89, Section 3], Wojciechowski 
gave a purely analytic reformulation of the details of their proof. This provides a 
third and completely elementary way of proving the regularity of the eta function 
at s = 0. The essential steps are: 

Theorem 3.1. Let V : C^{T>]E) C^{T,;E) denote a compatible Dirac 

operator over a closed manifold E of odd dimension m. Let e{t\x,x') denote the 
integral kernel of the heat operator e~^^ . Then there exists a positive constant C 
such that 

I TV x, x')) \ < CVi 

for all X eT. and 0 < t < 1. 

We recall the definition of the ‘local’ ry-function. 
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Definition 3.2, Let {fk; Xk}kez be a discrete spectral resolution of V. Then 
we define 

T]r,{s;x) := sign(Afc)lAfcrV/fc(a;)./fc(2:))E, 

1 



r(^ 

1 






Xke ifk{x)Jk{x)) ]dt 



poo 

i (— j Jo 

Corollary 3.3. Under the assumptions of the preceding theorem the JocaV 
eta function rjx>{s’,x) is holomorphic in the half plane ^{s) > —2 for any a: G S. 



In the decade or so following 1975, it was generally believed that the existence 
of a finite eta invariant was a very special feature of operators of Dirac type 
on closed manifolds which are boundaries, and then, more generally, of Dirac 
type operators on all closed manifolds. Only after the seminal paper by Douglas 
and Wojciechowski [DoWo91] was it gradually realized that globally elliptic self- 
adjoint boundary value problems for operators of Dirac type also have a finite eta 
invariant. Once again, there are quite different approaches to obtain that result. 

The work by Wojciechowski and collaborators is based on the Duhamel Prin- 
ciple and provides complete asymptotic expansions of the heat kernels for the 
self-adjoint Fredholm extension Vp where P belongs to the smooth self-adjoint 
Grassmannian. We recall from our review of the Atiyah-Patodi-Singer Index The- 
orem that the Duhamel Principle allows one to study the interior contribution and 
the boundary contribution separately and identify the singularities caused by the 
boundary contribution. It seems that Wojciechowski’s method is only applicable 
if the metric structures close to the boundary are product. 

Based on joint work with Seeley, Grubb [Gr99] also obtained nice asymptotic 
expansions of the trace of the heat kernels in (3.1) and (3.2). Contrary to the 
qualitative arguments of the Duhamel- Wojciechowski approach, Grubb’s approach 
requires the explicit computation of certain coefficients in the expansion. Some of 
them have to vanish to guarantee the desired regularity. 

For a slightly larger class of self-adjoint Fredholm extensions, Br fining and 
Lesch [BrLe99a] also studied the eta invariant. However, the authors had to deal 
with the residue of the eta function at s = 0 which is not present in the Duhamel- 
Wojciechowski approach. 

In spite of the differences between the various approaches and types of results 
it seems that one consequence can be drawn immediately, namely there must be 
a deeper meaning of the eta invariant beyond its role as error term in the APS 
index formula. Happily, such a meaning was found by Singer in [Si85] for the 
eta invariant on closed manifolds and successively generalized by Wojciechowski 
and collaborators for manifolds with boundary, namely the identification of the 
eta invariant as the phase of the zeta function regularized determinant. We shall 
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explain this now, and postpone our main topic, the pasting formulas for the eta 
invariant on partitioned manifolds. 



3.1. Functional integrals and spectral asymmetry. Several important 
quantities in quantum mechanics and quantum field theory are expressed in terms 
of quadratic functionals and functional integrals. The concept of the determinant 
for Dirac operators arises naturally when one wants to evaluate the corresponding 
path integrals. As Itzykson and Zuber report in the chapter on Functional Methods 
of their monograph [ItZuSO]: “The path integral formalism of Feynman and Kac 
provides a unified view of quantum mechanics, field theory, and statistical models. 
The original suggestion of an alternative presentation of quantum mechanical am- 
plitudes in terms of path integrals stems from the work of Dirac (1933) and was 
brilliantly elaborated by Feynman in the 1940s. This work was first regarded with 
some suspicion due to the difficult mathematics required to give it a decent status. 
In the 1970s it has, however, proved to be the most flexible tool in suggesting new 
developments in field theory and therefore deserves a thorough presentation.” 

We shall restrict our discussion to the easiest variant of that complex matter 
by focusing on the partition function of a quadratic functional given by the Eu- 
clidean action of a Dirac operator which is assumed to be elliptic with imaginary 
time due to Wick rotation and coupled to continuously varying vector potentials 
(sources, fields, connections), for the ease of presentation in vacuum. We refer to 
Bertlmann, [Be96] and Schwarz, [Sch93] for an introduction to the quantum the- 
oretic language for mathematicians and for a more extensive treatment of general 
aspects of quadratic functionals and functional integrals involving the relations to 
the Lagrangian and Hamiltonian formalism. 

There are various alternative notions of “path integral” around, some more 
sophisticated than others. A mathematically rigorous formulation of the concept 
of “path integrals”, as physicists typically “understand” it in quantum field the- 
ory is flimsy at best. For fields on Minkowski space, they are not mathematical 
integrals at all, because no measure is defined. For fields on Euclidean space (with 
imaginary time), one can construct genuine measures in limited settings which are 
not entirely realistic. Even then there is the issue of continuing the integrals back 
to real time which is generally ill-defined on a curved space-time. Many physicists 
do not care about such matters. Indeed, such physicists use path integrals primar- 
ily as compact generators of recipes to produce Feynman integrals which when 
regularized and renormalized yield coefficients in a formal power series in coupling 
constants for physical quantities of interest. However, no one has ever proved that 
these series converge, even for quantum electrodynamics (QED). Indeed the con- 
sensus of those who care is that these are only asymptotic series. Adding first 
few terms of these renormalized perturbation series yields remarkable 11-decimal 
point agreement with experiment, and QED is thereby hailed as a huge success. 
For many mathematicians and a few physicists, the great tragedy is that these 
recipes work so well without a genuine mathematical foundation. Although path 
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integrals may not make precise sense per se, not only do they generate success- 
ful recipes in physics, but they can motivate fruitful ideas and precise concepts. 
In mathematics, path integrals have motivated the ^-regularized determinant for 
the (Euclidean) Dirac operator, as a mathematically genuine canonical object, in- 
dependent of particular choices made for regularization, which can be precisely 
calculated in principle. 

A special feature of Dirac operators is that their determinants involve a phase, 
the imaginary part of the determinant’s logarithm. As we will see now, this is a con- 
sequence of the fact that, unlike second-order semi-bounded Laplacians, first-order 
Dirac operators have an infinite number of both positive and negative eigenval- 
ues. Then the phase of the determinant reflects the spectral asymmetry of the 
corresponding Dirac operator. 

The simplest path integral we meet in quantum field theory takes the form of 
the partition function and can be written formally as the integral 

(3.3) Z{(}):= j duj , 

where duj denotes functional integration over the space T := F(M; E) of sections 
of a Euclidean vector bundle E over a Riemannian manifold M. 

In quantum theoretic language, M is space or space-time; a a; G T is a position 
function of a particle or a spinor field. The scaling parameter /3 is a real or complex 
parameter, most often (3 = 1. The functional S' is a quadratic real- valued functional 
on r defined by S{lo) := {uj, Tuj) with a fixed linear symmetric operator T : F ^ F. 
Typically T is a Dirac operator and S{ijo) is the action S{u) = {u,Vlo). 

Mathematically speaking, the integral (3.3) is an oscillating integral like the 
Gaussian integral It is ill-defined in general because: 

(I) As it stands, it is meaningless when dimF(M;E) = Too (i.e., when 
dimM > 1). 

(II) Even when dimF(M; E) < oo (i.e. when dimM == 0 and M consists of a 
finite set of points), the integral Z{/3) diverges unless (3S{cu) is positive 
and nondegenerate. 

Nevertheless, these expressions have been used and construed in quantum field 
theory. As a matter of fact, reconsidering the physicists’ use and interpretation of 
these mathematically ill-defined quantities, one can describe certain formal ma- 
nipulations which lead to normalizing and evaluating Z{/3) in a mathematically 
precise way. 

We begin with a few calculations in Case II, inspired by Adams and Sen, 
[AdSe96], to show how spectral asymmetry is naturally entering into the calcula- 
tions even in the finite-dimensional case and how this suggests a definition of the 
determinant in the infinite-dimensional case for the Dirac operator. 

Then, let dim F = d < oo and, for a symmetric endomorphism T, let 

S{(jj) {(jU,Tu) for all lo 
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Case 1. We assume that S positive and nondegenerate, i.e. T is strictly posi- 
tive, say specT = {Ai, . . . with all A, > 0. This is the classical case. We choose 
an orthonormal system of eigenvectors (ci, . . . ^ed) of T as basis for F. We have 
S{(jo) = ^ for cj = ^ XjCj and, for real /? > 0, we get 

Z{P)= [ f 

JG 

/ OO nOO pOQ 

dxi / dx2 - e-/5AdX^ 

OO j —OO j — OO 

In that way the determinant appears when evaluating the simplest quadratic in- 
tegral. 

Case 2. If the functional S is positive and degenerate, T > 0, the partition 
function is given by 

Z{/3) = Vol(KerT), 

where ( := dimF — dimKerT and T := Tj^KerT)^: but, of course Vol(KerT) = oo. 
For approaches to “renormalizing” this quantity in quantum chromodynamics, we 
refer to [AdSe96], [BMSW97], [Sch93]. One approach customary in physics is 
to take 7r^/^/3“‘’/^(det as the definition of the integral by setting the factor 

Vol(KerT) equal to 1. 

Case 3. Now we assume that the functional S is nondegenerate, i.e. T in- 
vertible, but S is neither positive nor negative. We decompose F = F+ x F_ and 
T = T-i- 0 T_ with T+, — T_ strictly positive on F±. Formally, we obtain 

Z{P) dw+ j du>- 

where d± := dimr±, hence (^ = d^ + d- and |T| := = T_)_ 0 — T_. 

Case 4- In the preceding formula, the term is undefined 

for (5 G M±. We shall replace it by a more intelligible term for ^ = 1 by first 
expanding Z{/3) in the upper complex half plane and then formally setting p = 1. 
More precisely, let P G C+ = { 2 ; G C | > 0} and write P = \P\e^^ with 6 G [0, tt], 

hence ~P = \P\e^^^~'^^ with 0 — n e [— 7t, 0]. We set /3" := \P\^e^^^ and get 

p-d+l2^_Pyd_l2 ^ 

= \p\-^/‘^ e~^^^ e~^^^ e^^^ . 
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Moreover, 



e 



d- 



6 



(c?_i_ + d—) + ■ 



d- d- d^ 

T T 1 2 



0 ^ 7T X ^ 

-2< + J«-v) = -j 



26»C 



+ ('?-<) 



where d^-\-d- is the finite-dimensional equivalent of the C-invariant, counting 
the eigenvalues, and rj := d-^ — d- is the finite-dimensional equivalent of the 
7y-invariant, measuring the spectral asymmetry of T. We obtain 

^ (0) = 7r^/2 |/3|-f/2 g-if (2^+(’7-0) (det |T|)-i/ 2 
and, formally, for = 1, i.e., ^ = 0, 

(3.4) Z{1) = (det \T\)~^/^ . 

N V ^ 

= : det T 

Equation (3.4) suggests a nonstandard definition of the determinant for the infinite- 
dimensional case. 



Remark 3.4. 

(a) The methods and results of this section also apply to real-valued quadratic 
functionals on complex vector spaces. Since the integration in (3.3) in this 
case is over the real vector space underlying F, the expressions for the partition 
functions in this case become the square of those above. 

(b) In the preceding calculations we worked with ordinary commuting numbers 
and functions. The resulting Gaussian integrals are also called bosonic inte- 
grals. If we consider fermionic integrals, we work with Grassmannian variables 
and obtain the determinant not in the denominator but in the nominator (see 
e.g. [BeGeVe92] or [Be96]). 



3.2. The (^-determinant for operators of infinite rank. Once again, 
our point of departure is finite-dimensional linear algebra. Let T : ^ be an 

invertible, positive operator with eigenvalues 0<Ai<A2<---<Ad. We have 
the equality 

detT = HAj =exp{^lnAje-*‘"^^|^^o} 

= exp(- 

where Ct(«) := Ej=i V*' 

We show that the preceding formula generalizes naturally, when T is replaced 
by a positive definite self-adjoint elliptic operator L (for the ease of presentation, 
of second order, like the Laplacian) acting on sections of a Hermitian vector bundle 
over a closed manifold M of dimension m. Then L has a discrete spectrum {Aj}j^^ 
with 0 < Ai < A 2 < • • • , satisfying the asymptotic formula A^ ~ Cn™/2 for 
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a constant C > 0 depending on L (see e.g. [Gi95], Lemma 1.6.3). We extend 
Cl{s) := YlJLi ill complex plane by 

Cl{s) ■■= Tre~^^ dt 

r(«5) Jo 

with r(s) := Note that is the heat operator transforming any 

initial section fo into a section ft satisfying the heat equation Lf — 0. 

Clearly Tre-^^ = 5] . 

One shows that the original definition of Cl{s) yields a holomorphic func- 
tion for 3^(s) large and that its preceding extension is meromorphic in the entire 
complex plane with simple poles only. The point s = 0 is a regular point and 
Cl{s) is a holomorphic function at s = 0. From the asymptotic expansion of 
r(s) ~ ^ + 7 + sh{s) close to s = 0 with the Euler number 7 and a suitable 
holomorphic function h we obtain an explicit formula 

1^00 . 

C1(0)~/ -Tre-^^dt-jaiO). 

Jo ^ 

This is explained in great detail, e.g., in [Wo99], Therefore, Ray and Singer in 
[RaSiTl] could introduce det;^(L) by defining: 

det^L . 

The preceding definition does not apply immediately to the main hero here, the 
Dirac operator V, which has infinitely many positive Xj and negative eigenvalues 
— /i^ . Clearly by the preceding argument 

detzV^ = and dQiz\^\ = = e“Kx >2 

For the Dirac operator we set 

IndetD := -£Cp(s)U=o 

with, choosing^ the branch (— 1 )“^ = 

fr(») - E vj' = E E cj' 

- + E>-7’) + j(E V - Eo;’) 

+ { 5 (E + E »-;■ ) 4 (S - E ^ ■) } 

= i + w>(s)} + le"' {<p,(D - ncM ] . 



^Choosing the alternative representation, namely ( — 1)“^ = ^-nrs opposite sign 

of the phase of the determinant which may appear to be more natural for some quantum field 
models and also in view of (3.4). However, we follow the more common convention introduced 
by Singer in [Si85, p. 331] when defining the determinant of operators of Dirac type. 
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where r]x>{s) := Later we will show that rjx>{s) is a holomorphic 

function of s for ^{s) large with a meromorphic extension to the whole complex 
plane which is holomorphic in the neighborhood of s = 0. We obtain 

— iCx>2(f) + 

+ ii7re-{Cp2(f ) - ryp(s)} + 

It follows that 

Cvio) = H'vm + f {Ci>^(o) - vv{o)} , 

and 

det,P = e-ic; 2 ( 0 ) g-^{C^ 2 ( 0 )-r,^( 0 )} 

— g— ^{C|X)|(0)— ??x>(0)} g— C[x>|(0) 

So, the Dirac operator’s ‘partition function’ in the sense of (3.3) becomes 

Z(l) -7r‘^i^i^®)(detcD)“^ . 

3.3. Spectral invariants of different ‘sensitivity’. We discuss the four 
spectral invariants of the Dirac operator V that enter in the preceding formulas. 

3.3.1. The index. First recall that the index of arbitrary elliptic operators on 
closed manifolds and the spectral flow of 1-parameter families of self-adjoint ellip- 
tic operators are topological invariants and so stable under small variation of the 
coefficients and, by definition, solely depending on the multiplicity of the eigen- 
value 0, In the theory of bounded or closed (not necessarily bounded) Fredholm 
operators and bounded or not necessarily bounded self-adjoint Fredholm opera- 
tors and the related K and K~^ theory, we have a powerful functional analytical 
and topological frame for discussing these invariants. Moreover, index and spectral 
flow are local invariants, i.e., can be expressed by an integral where the integrand 
is locally expressed by the coefficients of the operator(s). Consequently, we have 
simple, precise pasting formulas for index and spectral flow on partitioned mani- 
folds where the error term is localized along the separating hypersurface. 

On manifolds with boundary the Calderon projection and its range, the Cauchy 
data space, change continuously when we vary the Dirac operator as shown in Sec- 
tion 2.3.8, exploiting the unique continuation property of operators of Dirac type. 
The same is not true for the At iyah-Patodi- Singer projection: It can jump from 
one connected component of the Grcissmannian to another component under small 
changes of the Dirac operator. Correspondingly, the index of the APS boundary 
problem can jump under small variation of the coefficients (i.e., of the defining 
connection or the underlying Riemannian or Clifford structure). 

Regarding parity of the manifold, the index density (of all elliptic differential op- 
erators) vanishes on odd-dimensional manifolds for symmetry reason. Then, in the 
closed case the index vanishes, and on manifolds with boundary the APS Index 
Theorem takes the simple form index = — dimKerR+ where we have the 
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total Dirac operator on the left and a chiral component of the induced tangential 
operator on the right. Once again, the formula shows the instability of the index 
under small changes of the Dirac operator. This is no contradiction to the stability 
of the index on the spaces T ^ respectively CT ^ discussed in Section 1.1.3 because 
the graph norm distance between two APS realizations and can remain 
bounded away from zero when V runs to V . This is the case if and only if the 
dimension of the kernel of the tangential operator changes under the deformation. 

3.3.2. The (.-invariant. Similarly, is also local; i.e., it is given by the 

integral a{x)dx, where a{x) denotes a certain coefficient in the heat kernel 
expansion and is locally expressed by the coefficients of V. In particular, Cx> 2 ( 0 ) 
remains unchanged for small changes of the spectrum. Actually, Cl( 0) vanishes 
when L is the square of a self-adjoint elliptic operator on a closed manifold of odd 
dimension. It can be defined (and it vanishes, see [PaWo02a, Appendix]) for a 
large class of squares of operators of Dirac type with globally elliptic boundary 
conditions on compact, smooth manifolds (of odd dimension) with boundary. So, 
there are no nontrivial pasting formulas at all in such cases. 

3.3.3. The r]-invariant. Unlike the index and spectral fiow on closed manifolds, 
we have neither an established functional analytical nor a topological frame for 
discussing r/p(0), nor is it given by an integral of a locally defined expression. On 
the circle, e.g., consider the operator 

(3.5) := -i4- + a = 

ax 

so that T>a and Vq have the same total symbol (coincide locally), but r]x>a ( 0 ) = —2a 
depends on a. 

The 77 -invariant depends, however, only on finitely many terms of the symbol of 
the resolvent and the real part (in M/Z) will not change when one changes 

or removes a finite number of eigenvalues. The integer part changes according to 
the net sign change occurring under removing or modifying eigenvalues. Moreover, 
the first derivative of the eta invariant of a smooth 1-parameter family of Dirac 
type operators is local, namely the spectral fiow, as noted in our introduction. 
This leads again to precise (though not so simple) pasting formulas for the eta 
invariant on partitioned manifolds. 

In even dimensions, the eta invariant vanishes on any closed manifold E for 
any Dirac type operator which is the tangential operator of a Dirac type operator 
on a suitable manifold which has S as its boundary because of the induced precise 
symmetry of the spectrum due to the anti-commutativity of the tangential operator 
with Clifford multiplication. For the study of eta of boundary value problems on 
even-dimensional manifolds see [KlWo96j. 

3.3.4. The modulus of the determinant The number Cp 2 ( 0 ) is the most deli- 
cate of the invariants involved: It is neither a local invariant, nor does it depend 
only on the total symbol of the Dirac operator. Even small changes of the eigenval- 
ues will change the (' invariant and hence the determinant. Moreover, no precise 
pasting formulas are obtained but only adiabatic ones (i.e., by inserting a long 
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cylinder around the separating hypersurface (see [PaWo02a], [PaWo02b], and 
[PaWo02c]). 

Without proof we present the main results by Wojciechowski and collabora- 
tors, based on [Wo99] where the (^-function regularized determinant was estab- 
lished for pseudo-differential boundary value conditions belonging to the smooth, 
self-adjoint Grassmannian. The first is a boundary correction formula, proved in 
[ScWoOO] (see also the recent [Sco02]): 

Theorem 3.5 (Scott, Wojciechowski). Let V he a Dirac operator over an odd- 
dimensional compact manifold M with boundary S and let P G Qr^^{V). Then the 
range of the Calderon projection V{T>) {the Cauchy data space A{D, |)) and the 
range of P can be written as the graphs of unitary, elliptic, zero order operators 
K and T, respectively, which differ from the operator 

: C'°°(S;5+|s) ^ C°°(S; S-ls) 



by a smoothing operator. Moreover, 



(3.6) det^Pp = det(^X>p(p>) • detpr^(/ T KT ~^) . 

The second result, in most simple form, is found in [PaWoOO]: 

Theorem 3.6 (Park, Wojciechowski). Let R eR be positive, let denote 
the stretched partitioned manifold = Mi Us [— jR, 0] x E Us [0, i^] x E Us M 2 , 
and let T>r, Vi^r, and X> 2 ,r denote the corresponding Dirac operators. We assume 
that the tangential operator B is invertible. Then 



lim 

i?— >CX) 







2-Cb2(o)^ 



Although Felix Klein in [K127] rated the determinant as simplest example 
of an invariant, today we must give an inverse rating. For the present authors, 
it is not the invariants that are stable under the largest transformation groups 
which deserve the highest interest, but rather (according to Dirac’s approach to 
elementary particle physics) the finest invariants which exhibit anomalies under 
small perturbations. Correspondingly, the determinant and its amplitude are the 
most subtle and the most fascinating objects of our study. They are much more 
difficult to comprehend than the 77 - invariant 3.3.2; and the 77 -invariant is much 
more difficult to comprehend than the index. 

3.4. Pasting formulas for the eta invariant - outlines. In the rest of 
this review, i.e. over the next 33 pages, we will prove a strikingly simple (to state) 
additivity property of the 77 -invariant. We fix the assumptions and the notation. 
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3.4.1. Assumptions and notation, (a) Let M be an odd-dimensional closed 
partitioned Riemannian manifold M = Mi Us M 2 with Mi, M 2 compact manifolds 
with common boundary E. Let 5 be a bundle of Clifford modules over M. 

(b) To begin with we assume that D is a compatible Dirac operator over M. Thus, 
in particular, V is symmetric and has a unique self-adjoint extension in L^{M] S). 

(c) We assume that there exists a bicollared cylindrical neighborhood (a neck) 
N ~ (—1,1) X E of the separating hypersurface E, such that the Riemannian 
structure on M and the Hermitian structure on S are product in N; i.e., they do 
not depend on the normal coordinate u, when restricted to E^^ = {u} x E. Our 
convention for the orientation of the coordinate u is that it runs from Mi to M 2 ; 
i.e.. Ml D N = (—1,0] x E and N n M 2 = [0, 1) x E. Then the operator V takes 
the following form on N: 

(3.7) V\N = cr{du + B), 

where the principal symbol in ^/-direction a : *S|s *S'|s is a unitary bundle 
isomorphism (Clifford multiplication by the normal vector du) and the tangential 
operator B : (C^(E;5|x:) ^ C^(E;5|s) is the corresponding Dirac operator on 
E. Note that a and B do not depend on the normal coordinate u in N and they 
satisfy the following identities 

(3.8) (7* = -a, aB = -Ba, B^ = B. 

Hence, cr is a skew- adjoint involution and S, the bundle of spinors, decomposes 
in N into ±i-eigenspaces of a, 0 S~ . It follows that (3.7) leads to the 

following representation of the operator V in N 




where B^ : C°®(E; S~^) C'^(E; S ) maps the spinors of positive chirality into 

the spinors of negative chirality. 

(d) To begin with we consider only the case of Ker J5 = {0}. That implies that B 
is an invertible operator. More precisely, there exists a pseudo-differential elliptic 
operator L of order —1 such that BL = Is = LB (see, e.g., [BoWo93, Prop. 9.5]). 

(e) For real R > 0 we study the closed stretched manifold M^ which we obtain 
from M by inserting a cylinder of length 2R, i.e., replacing the collar N by the 
cylinder {~2R — 1, +1) x E 

= Ml U ([-2R,0] X E) U M 2 . 

We extend the bundle S to the stretched manifold M^ in a natural way. The 
extended bundle will be also denoted by S. The Riemannian structure on M and 
the Hermitian structure on S are product on N . Hence we can extend them to 
smooth metrics on M^ in a natural way and, at the end, we can extend the 
operator V to an operator on M^ by using formula (3.7). Then M^ splits into 
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two manifolds with boundary: U with 

= Ml U {{-2R, -i?] X E) , 

= i[-R,0) X E)UM2, 

and dM^ = dM^ = {—R} x Consequently, the operator splits into 

= Df U V^. 

We will impose spectral boundary conditions to obtain self-adjoint operators ^i,p< , 
, ^ 2 ,p> , and in the spaces on the corresponding parts (see (3.9)). 

(f) We also introduce the complete, noncompact Riemannian manifold with cylin- 
drical end 

:= ((-oo,0] X E)UM 2 

by gluing the half-cylinder (— oo,0] x E to the boundary E of M 2 . Clearly, the 
Dirac operator V extends also to C^{M^ , S). 

Remark 3.7. Our presentation is somewhat simplified by our assumption (b) 
that T> is compatible, and the assumption (d) that the tangential operator B is 
invertible. Both assumptions can be lifted, see [Wo95] and [Wo99]. 



We recall the following ideas in the big scheme from Section 2.5 of this review. 
Let P> (respectively P<) denote the spectral projection of B onto the subspace of 
L^(E; 5|x;) spanned by the eigensections corresponding to the positive (respectively 
negative) eigenvalues. Then P> is a self-adjoint elliptic boundary condition for the 
operator V 2 = 'D\m2 [BoWo93, Proposition 20.3]). This means that the 
operator P 2 ,p> defined by 



(3.9) 



7^2, p> = 7 >|m2 5 

Dom(p2,p>) = {se H\M2 -^S\m2) I P>{sk) = 0}, 



is an unbounded self-adjoint operator in L^(M 2 ; SIms) with compact resolvent. In 
particular, 

^ 2 ,p> • Dom(I> 2 ,p>) ^ L^(M2;5 |m2) 

is a Fredholm operator with discrete real spectrum and the kernel of ^ 2 ,p> consists 
of smooth sections of 5 |m2* 

As mentioned before, the eta function of P 2 ,p> is well defined and enjoys all 
properties of the eta function of the Dirac operator defined on a closed manifold. In 
particular, (0), the eta invariant of P 2 ,p> , is well defined. Similarly, P< is a 

self-adjoint boundary condition for the operator P|mi ? ^md we define the operator 
^i,p< using a formula corresponding to (3.9). 

To keep track of the various manifolds, operators, and integral kernels we refer 
to the following table where we have collected the major notations. 
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Manifolds 


Operators 


Integral kernels 


M = Ml Ux: M2 




S{t‘, X, x') 


MR = Us 




S^{t; X, x') 


M2 




S2{t;x,x') 


= ([-P, 0 ] X E)UM2 




S^{t;x,x') 


= ((-00, 0] X E)uM2 




£^{t;x,x') 


= (-00, +00) X E 


Dcyie~^^cyl 


£cyi{t-,x,x') 


V~i/2 = [0.+~) xS 




^aps (^5 X, X ) 



In addition, on we have the operator Q^it) with kernel x, x'), and 

C^{t) = with kernel C^(t;x,x'). 



3 . 4 . 2 . The gluing formulas. The most basic results for pasting rj are the follow- 
ing theorem on the adiabatic limits of the r] invariants and its additivity corollary: 

Theorem 3 . 8 . Attaching a cylinder of length R > 0 at the boundary of the 
manifold M2, we can approximate the eta invariant of the spectral boundary con- 
dition on the prolonged manifold by the corresponding integral of the docaV 
eta function of the closed stretched manifold M^: 

lim ( 0 )— / ?7p>r( 0; x) dx > = 0 mod Z. 

1^ 2,P> j 

Corollary 3 . 9 . 7 ?r>( 0 ) = ( 0 ) + rj'D2,p^ ( 0 ) mod Z. 

Remark 3 . 10 . (a) With hindsight, it is not surprising that modulo the integers 
the preceding additivity formula for the 77-invariant on a partitioned manifold is 
precise. An intuitive argument runs as follows. “Almost all” eigensections and 
eigenvalues of the operator V on the closed partitioned manifold M = Mi U M2 
can be traced back, either to eigensections and eigenvalues of the spectral 
boundary problem on the part Mi, or to eigensections 7/^2, € and eigenvalues 

P2/ of the spectral boundary problem T>2,p> on the part M2. While we have no 
explicit exact correspondence, due to the product form of the Dirac operator in a 
neighborhood of the separating hypersurface, eigensections on one part Mi or M2 
of the manifold M can be extended to smooth sections on the whole of M. These 
are not true eigensections of V, but they have a relative error which is rapidly 
decreasing as R 00 when we attach cylinders of length R to the part manifolds 
or, equivalently, insert a cylinder of length 2R in M. There is also a residual 
set {ijLoj} of eigenvalues of T> which can neither be traced back to eigenvalues of 
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nor to those of These eigenvalues can, however, be traced back to 

the kernel of the Dirac operators and on the part manifolds and 
with cylindrical ends. Because of Fredholm properties the residual set is finite and, 
hence (as noticed in Section 3.3) can be discarded for calculating the eta invariant 
modulo Z. 

Therefore, no R (i.e., no prolongation of the bicollar neighborhood N) en- 
ters the formula. Nevertheless, our arguments rely on an adiabatic argument to 
separate the spectrum of V into its three parts 

(3.10) specV - U U {/i 2 ,^}- 

For the most part, however, we need not make all arguments explicit on the level 
of the single eigenvalue. It suffices to work on the level of the eta invariant for the 
following reason. Unlike the index, the eta invariant cannot be described by a local 
formula, as explained in Section 3.3. Nevertheless, it can be described by an integral 
over the manifold. The integrand, however, is not defined in local terms solely. In 
particular, when writing the eta function in integral form and decomposing the rj 
integral 

riv{s) = / rjx>{s;x, x)dx = / rjx^{s;xi,xi) dxi + / t]t){s]X 2 ,X 2 ) dx 2 

J M JMi Jm2 

there is no geometrical interpretation of the integrals on the right over the two 
parts of the manifold. This is very unfortunate. But for sufficiently large i?, the 
integrals become intelligible and can be read as the rj invariants of and 

T> 2 p^ • That is the meaning of the adiabatic limit. 

(b) Theorem 3.41 can be generalized to larger classes of boundary conditions by 
variational argument (see [LeWo96]) yielding the general gluing formula (in M/Z) 

^X>(0) = (0) +^P>2,P2(^) + 

where r]p^ j_p^{0) denotes the /^-invariant on the cylinder see also [BrLe99], 
[DaPr94], [MaMe95] , and the recent review [PaWo02e]. G. Grubb’s new re- 
sult of [Gr02], mentioned in our introduction, may open an alternative route for 
proving the general gluing formula. The integer jump was calculated in [KiLeOO] 
yielding (among other formulais) 

^d(O) = '^i>i,/_p(0) + Vv2,p{^) + 2SF{T>i^/_pJ -f 2SF{I>2,Pt}5 

where {Pt} is a smooth curve in the Grassmannian from P to the Calderon pro- 
jection V(V 2 ). 

(c) An interesting feature of [KiLeOO] is that the pasting formula is derived from 
the Scott- Wojciechowski Comparison Formula (Theorem 3.5). This is quite analo- 
gous to the existence of two completely different proofs of the pasting formula for 
the index (Theorem 2.35), where also the derivation from the boundary reduction 
formula is much, much shorter than arguing via the Atiyah-Singer Index Theorem 
and the Atiyah-Patodi-Singer Index Theorem plus the Agranovic-Dynin Formula. 
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However, for this review we prefer the long way because of the many interesting 
insights about the gluing on the eigenvalue level which can be gained. 

3.4.3. Plan of the proof. Let S^{t) denote the integral kernel of the operator 
V 2 ) (defined on the manifold = ([— 0] x E) U M 2 . Without proof, 

we mentioned before that the eta invariant of the self-adjoint operator is 

well defined and we have 

1 dt f 

( 0 ) = ^ / -^ / TvS^{t-,x,x)dx 

V^T Jo ytjM^ 

1 df r 

(3.11) — ~T^ / ~~r \ Tr£^^(Z; X, t) dx 

1 /*00 ji n 

(3.12) -I — j= / Tr£^(Z;rr,a:) dx. 

We first deal with the integral of (3.11) and show that it splits into an interior 
contribution and a cylinder contribution as R 00 . This will be done in Section 3.5 
by first in 3.5.1 applying the Duhamel method which we introduced before in 
the proof of Theorem 2.30 (pp. 63ff). By Lemma 3.11, Lemma 3.12, Proposition 
3.13, and Corollary 3.14, we can replace the heat kernel 8^ of the Atiyah-Patodi- 
Singer boundary problem on the prolonged manifold with boundary E by an 
artificially glued integral kernel which, near the boundary, is equal to the heat 
kernel of the APS problem on the half-infinite cylinder and in the interior equal 
to the heat kernel on the stretched closed manifold. We can do it in such a way 
that the original small-Z integral (i.e., the integral from 0 to y/R in (3.11)) can 
be approximated by the new integral up to an error of order Then we 

will show in Lemma 3.15 and Lemma 3.16 (Paragraph 3.5.2) that the cylinder 
contribution is traceless. More precisely, we obtain that the trace Tr Q^(T; x, x) 
can be replaced pointwise (for x G M^) by the trace Tv 8^{t\x,x) of the integral 
kernel of the operator ^ which is defined on the stretched manifold M^. 

Consequently, the small-Z chopped ? 7 -invariant of the closed stretched manifold 
coincides with the sum of the small-Z chopped ry-invariants of the APS problems 
on the two prolonged manifolds and up to O (e“^^) . 

Then we will show that the integral of (3.12) vanishes as R 00 . This is 
in Lemma 3.29 (p. 114f) a direct consequence of Theorem 3.17 which states that 
the eigenvalues of uniformly bounded away from 0. Theorem 3.17 is of 

independent interest. The proof is a long story stretching over Sections 3.6 and 3.7. 
First, in Paragraph 3.6.1 we will consider the operator Dcyi on the infinite cylinder 
E^j in Definition 3.19 and Lemma 3.20. We obtain that Dcyi has no eigenvalues 
in the interval (— Ai,Ai) where Ai denotes the smallest positive eigenvalue of the 
tangential operator B on the manifold E. Next, in Paragraph 3.6.2 we investigate 
the operator on the manifold with infinite cylindrical end in Lemma 3.21, 
Lemma 3.22, Lemma 3.23, and Proposition 3.24. Proposition 3.24 states that 
has only finitely many eigenvalues in the aforementioned interval (— Ai,Ai), each 
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of finite multiplicity. Its proof is somewhat delicate and involves Lemma 3.26 
and Corollary 3.27. Then, in Section 3.7 the proof of Theorem 3.17 follows with 
Lemma 3.28. 

By then we will have that the sum of the ry-invariants of the APS boundary 
problems on the prolonged manifolds and can be replaced by the small-t 
chopped r/-invariant on the stretched closed manifold with an error exponen- 
tially vanishing as R oo. We then would like to repeat the preceding chain of 
arguments around Theorem 3.17 to show that the large-t chopped ?7-invariant of 
the operator on also vanishes. However, this can be done only in M/Z be- 
cause in general the eigenvalues of are not bounded away from 0. So we shall 
present a different chain of arguments in Section 3.8. The main technical result 
is Theorem 3.30, once again of independent interest. It describes a partition of 
the eigenvalues into two subsets, the exponentially small ones and the eigenvalues 
bounded away from 0. The key for our arguments is a gluing construction (Defini- 
tion 3.31). Then we first show by Lemma 3.32, Lemma 3.33 and Proposition 3.34 
that has at least q dimKerPf^ -h dimKerDg^ exponentially small eigen- 
values belonging to eigensections which we can approximate by pasting together 
solutions. Then we shall show in Lemma 3.35, Theorem 3.36, Lemma 3.37 and 
Proposition 3.38 that this makes the list of eigenvalues approaching 0 as R ^ oo 
complete. 

It follows in Lemma 3.39 (at the beginning of the closing Section 3.7) that the 
large-t chopped 77-invariant on vanishes asymptotically up to an integer error. 
This establishes Theorem 3.8. To arrive at Corollary 3.9, we must get rid of the 
adiabatic limit. This is a simple consequence of the locality of the derivative in in- 
direction of the ry-invariants on the stretched part manifolds with APS boundary 
condition and on the stretched closed manifold (Proposition 3.40). 



3.5. The adiabatic additivity of the small-t chopped ry-invariant. 

3.5.1. Applying DuhameVs method to the small-t chopped rj -invariant. The 
simplest construction of a parametrix for S^{t) (i.e., of an approximate heat kernel) 
is the following: we glue the kernel 8 of the operator Ve~^^ (given on the whole, 
closed manifold M) and the kernel 8^^ of the extension of the operator a{du + 
^ given on the semi-infinite cylinder [-R, 00) x E and subject to the 
Atiyah-Patodi-Singer boundary condition at the end u = —R. In that construction 
the gluing happens on the neck N — [0,1) x with suitable cutoff functions. 

Locally, the heat kernel is always of the form By 

DuhamePs Principle we get after gluing a similar global result for the kernel 
e 2 (t;x,x') of the operator and, putting a factor in front, for 

the kernel of the combined operator Ve~ ^ (e.g., see [Gi95, Lemma 1.9.1]). 

That yields two crucial estimates: 
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Lemma 3.11. There exist positive reals C2 , and c^, which do not depend on 
R, such that for all x^x' G M^, and any t > 0 and R> 0, 

(3.13) |ef < Cit~^ e""^^ \ 

(3.14) \E^{t',x,x')\ <cit~^^ gC2t g-c3 

Here d{x,x') denotes the geodesic distance. 

Notice that exactly the same type of estimate is also valid for the kernel 
S^{t;x^x') on the stretched closed manifold and for the kernel S^^{t;x,x') 
on the infinite cylinder. For details see also [BoWo93, Theorem 22.14]. There, 
however, the term ^^s suppressed in the final formula because the emphasis 
was on small time asymptotics. 

As mentioned before, as R oo, we want to separate the contribution to the 
kernel 8 ^ which comes from the cylinder and the contribution from the interior 
by a gluing process. Unfortunately, the inequality 3.14 does not suffice to show 
that the contribution to the eta invariant, more precisely to the integral (3.11), 
which comes from the ‘error’ term vanishes with R oo. Therefore, we introduce 
a different parametrix for the kernel 82 • 

Instead of gluing over the fixed neck N = [0, 1) x E, we glue over a segment 
of growing length of the attached cylinder, say := {—^R,—^R) x E (the 
reason for choosing these ratios will be clear soon). Thus, we choose a smooth 
partition of unity {Xaps,Xint} on suitable for the covering {Uaps,Uint} with 
i^aps := [--R, -fi?) X E and U-,nt := ((-|ii,0] x E) UM 2 , hence C/apsHf/int = N^. 
Moreover, we choose nonnegative smooth cutoff functions {'0aps,^int} such that 

i[)j = 1 on {x G M 2 I dist(x,suppxj) < \R^ and 
ijjj =0 on {x G M 2 I dist(x, suppxj) > 
for j G {aps,int}. We notice 

(3.15) dist(supp^',suppxj) — dist(supp'0'', suppxj) > 

Moreover, we may assume that 

d^ipj ^ Co 

- R 

for all A:, where Cq is a certain positive constant. 

For any parameter ^ > 0, we define an operator on 0 ^{M 2 \ S) with a 

smooth kernel, given by 

(3.16) Q^{t] X, x') ■- ipaps{x)S^^{t-, X, a:')Xaps(a;') + ipint{x)£^{t; x, x')x\nt{x')- 

Recall that 8 ^ denotes the kernel of the operator ^ given on the 

stretched closed manifold M^. Notice that, by construction, Q^it) maps the space 
L‘^{M^; S) into the domain of the operator 
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Then, for x' G f/aps with Xaps(^0 — 1, we have by definition: 



(3.17) 



Q^{t\x,x') 



^') if d{x, supp Xaps) < \R, 

0 if d(a;, supp Xaps) > ^R- 



Correspondingly, we have for x' € f/int with Xint(a:0 = 1> 



(3.18) 






X, x') if d(x, supp Xint) < 

0 if d(x,suppxint) > 1^- 



For fixed t > 0, we determine the difference between the precise kernel 6^^(t;x,x') 
and the approximate one Q2{t;x,x'). Let C^{t) denote the operator 

C^{t) = Q^i^) with kernel C^{t;x,x'). 

By definition, we have Thus, C^{t) ‘ measures’ the 

error we make when replacing the precise kernel S^{t;x,x') by the glued, approx- 
imate one. 

More precisely, we have by Duhamel’s Formula 

- Qf (t;x,x') = - [ ds [ dz S^is'.x, z)C^{t - s] z,x') 

Jo Jm^ 

with 

C^{t - s; x') = ((I? 2 '!(.))' + R) Q2O - S-, Z, x') 

= - s) - s;z,x') 

d 

= V^aps(2^)^5>s(^ - s;z,x')x^ps{x') + 2'ip'^p^{z) — {E^^^{t - S]Z,x'))Xe.ps{x') 

+ '0aps(^) (j^(z) ~ ds) ^aps(^ — S; Z, X ) Xaps(^ ) 

V ^ 

=0 

o 

+ ' 0 int(^)^^(f - «; 2, x')Xmt{x') + 2lpl„^{z)~{S^{t - s; Z, x'))Xmt{x') 

+ V’int(^) - S-, Z, x') X\nt{x')- 

" C ' 

=0 

Here, denotes the operator V acting on the 2 variable; and in the partial 
derivative ^ the letter u denotes the normal coordinate of the variable 2 ;. 

As stated in (3.15), the supports of Xj (and, equally, i/jj) are disjoint 

and separated from each other by a distance R/7 in the normal variable for j E 
{aps,int}. Then the error term C^{t — s;z,x') vanishes both for the distance in 
the normal variable d{z, x') < R/7 and, actually, whenever z or x' are outside the 
segment [—^R,^R] x S. 
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Let 2 : and x' be on the cylinder and \u — v\ > R/1 where u and v denote 
their normal coordinates. We investigate the error term C^{t — s\z^x') which 
consists of six summands. Two of them vanish as we have pointed out above. 
The remaining four summands involve the kernels — s;z,x') on the infinite 

cylinder [— 00 ) x E and — s;z^x') on the stretched closed manifold M^. 
We shall use that both kernels can be estimated according to inequality (3.14). 
We estimate the first summand 



IV’aps(^)^Ss(i - s;^,a;')Xaps(a;')l < ^Ci{t - s)- 



dfi (z,x') 



<c[ 



oC2tp-c'^R^ It 



Here we have used t > s >0, and 
Similarly we estimate the second summand 



< ce 



(z,x') 

2 t 



, ,/ f 



"aps(^ 2^) 2 ; )Xaps(3J ) 
CqCi (t- sY 



< 



R 



Vi 



■ e“ 






< c'l i 



c'^R^ jt 



where the factor 1 /V^ comes from the differentiation of the kernel as explained 
before. The third and fourth summands, involving the kernel of the closed 
stretched manifold M^, are treated in exactly the same way. Altogether we have 
proved the following: 



Lemma 3.12. The error kernel C^{t;u,v) vanishes for u ^ [—^R,—jR]. 
Moreover, C^{t]u,v) vanishes whenever \u — v\ < R/1 . For arbitrary x,x' G 
we have the estimate 

\C^{t-x,x')\ < Cl 

with constants c\, C 2 , C 3 independent of x,x' ,t,R. 



We consider the pointwise error 

S2{t\x,x) - Q2{t]x,x) = [ ds f (s;x,2:)C^(t - s;z,x). 

Jo Jm^ 

We obtain the following proposition as a consequence of the preceding lemma. 

Proposition 3.13. For all x e and allt>0 we have 

Tr S^it] x,x) -Tr x,x) = Tr {S^it; x, x) - Qf (^; x, x)) . 

Moreover, there exist positive constants Ci, C2, C3, independent of R, such that the 
^ error’ term satisfies the inequality 

\S2{t‘,x,x) - Qf (t;x,x)| < Cl 
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Proof. We estimate the error term 
\S^{t\x,x) - Q^{t-,x,x)\ 



r 


r 




< ds 


/ dz\S2{s',x,z)C^{t — s\ 


Jo 


Jm^ 




< c?e'=^‘ 


[ ds 


[ dz\s-^e~^^—^ 




lo 


Jm^ ^ 


< 


[ ds 


/ dze~ 




lo 


Jsupp^ C^{t—s;z,x) 




[ ds 


f dze~' 




lo 


/ supp^ C^{t—s;z,x) 



d^{x,z) d^{x,z) 

e 









<c\e^‘^^cR / dse < c\e^'^^2cR / dse 

Jo 

tl2 



— c^e^‘^^2cR f dse 
Jo 



Here we have used that Vol(supp_^ C^{t — s; z, x)) ~ Vol(E) -i? according to Lemma 
3.12. We investigate the last integral. 



-5 *.-/’£!, 

Jo Jo c 



e-H—^)ds 



■‘-I ~c‘ = 



, «' -I 

e dr — — e t . 



Thus we have 



^ 2 

X, x) — x,x)\ < 2cR — — e~~^ < Cj e^ 2 tg-c 8 (R /t) ^ 

CqR^ 



□ 

The preceding result shows that, for t smaller than \/S, the trace TrS^it; x, x) 
of the kernel of the operator approaches the trace TrQ^(t;a:,x) of 

the approximative kernel pointwise as R oo. In particular, we have: 

Corollary 3.14. The following equality holds, as R ^ oo, 
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Proof, We have 




and we have to show that the second summand on the right side is 0(e as 
R oo. We estimate 







□ 

3.5.2. Discarding the cylinder contributions. Corollary 3.14 shows that the 
essential part of the local eta function of the spectral boundary condition on the 
half manifold with attached cylinder of length R, i.e., the ^small-time’ integral from 
0 to \/R can be replaced, as oc, by the corresponding integral over the trace 
TrQ 2 {t;x,x) of the approximate kernel, constructed in (3.16). Now we show that 
TrQ 2 {t]x,x) can be replaced pointwise (for x G M^) by the trace Tr E^{t;x^x) 
of the kernel of the operator ^ which is defined on the stretched closed 

manifold M^. 

Consider the Dirac operator 

(7{du + B) : C^([0, oo) X E; S') C^([0, oc) x E; S), 

on the semi- infinite cylinder with the domain 

{s € Co°°([0,oo) X E;5) 1 F>(s|{o}xe) = O}. 

It has a unique self-adjoint extension which we denote by Daps- Recall that the 
integral kernel of the operator Daps enters in the definition of the 
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approximative kernel Q 2 as given in (3.16). We show that x) is traceless 

for all X G [0, 00 ) X E. Then, it follows 

(3.19) TiQ 2 {t]x^x) —Tr: S^{t]x^x) for all x G 

To prove that a product TV is traceless, the following easy result can be used. 

Lemma 3.15. Let a be unitary with cr^ = —I. We consider an operator V of 
trace class which is ^even’, i.e., it commutes with a. Moreover, T is odd, i.e., it 
anticommutes with a. Then 

Tr{TV) = 0. 

Proof. We have, by unitary equivalence, 

Tt{TV) - Ti{-a{TV)a) - Tr(-aTcry) = Tr(a^TV') = Tr(-TP). 

□ 

Lemma 3.16. Let x • [0,oo) W be a smooth function with compact support 
and t > 0. Then the trace of the operator x^aps vanishes. In particular, 

for all u G [0, 00 ) . 

Proof. Clearly, = {a{du + B)f = -dl + is even, hence also the 
power series e~d^aps)^ jg even. On the other hand, as with B, cfB is also odd. So, 

To show that 

Tr ~ 

we need a slightly more specific argument: Let e^g denote the heat kernel of the 
operator Daps- For u, u G [0, 00 ) and y, 2 : G E it has the following form (see e.g. 
[BoWo93, Formulae 22.33 and 22.35]): 

eaps(i;«,y;w,2) = '^ek{t\u,v)ipk{y) ® y^l{z) 

k^'Zi 

for an orthonormal system {(fk} of eigensections of B. Hence, 
adue^ps{t\u,y,v,z) = u, v)cr(pk{y) ® 

kez 

But {(Tifk] (fk) = 0 on E since a is skew- adjoint. □ 
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3.6. Asymptotic vanishing of the large-t chopped ? 7 -invariant on 
stretched part manifold. 

So far we have found 



1 df f 

i^) = -r ~7i Ti€^{t;x,x)dx + 0{e~‘=^) 

"••P> Vtt Jo y/t JmJ‘ 

f ^ f TrS2{t;x,x)dx 

as i? ^ oo. To prove Theorem 3.8, we still have to show 



(3.20) 

(3.21) 




X, x) dx = 0(e 
Tr£:^(^;x,x) dx = 0{e~^^ 



and 



as ^ oo. Recall that x, x') denotes the kernel of the operator V^e ) 

on the compact manifold with boundary {— R} x E, and S^{t\x,x') the kernel 
of the operator ^ on the closed stretched manifold 



In the following we show (3.20), i.e., that we can neglect the contribution to 
the eta invariant of T> 2 p^ which comes from the large t asymptotic of x, x'). 
The key to that is that the eigenvalue of with the smallest absolute value 

is uniformly bounded away from zero. 



Theorem 3.17. Let iio{R) denote the smallest {in absolute value) nonvan- 
ishing eigenvalue of the operator V 2 P manifold M^. Let us assume, as 

always in this section, that Ker B = {0}. Then there exists a positive constant cq, 
which does not depend on R, such that jJ>o{R) > cq for R sufficiently large. 



Remark 3.18. As we will discover, this result indicates that the behavior of 
the small eigenvalues on differs from that on the stretched, closed manifold 
M^. On the manifold with boundary with the attached cylinder of length 
R, the eigenvalues are bounded away from 0 when R 00 due to the spectral 
boundary condition. That is the statement of Theorem 3.17 which we are going to 
prove in the next two sections. However, on M^, the set of eigenvalues splits into 
one set of eigenvalues becoming exponentially small and another one of eigenvalues 
being uniformly bounded away from 0 as — > 00 . This we are going to show further 
below. Roughly speaking, the reason for the different behavior is that on the 
eigensections must satisfy the spectral boundary condition. Therefore they are 
exponentially decreasing on the cylinder, and the eigenvalues are bounded away 
from 0. But on we have to cope with eigensections on a closed manifold which 
need not decrease, but require part of the eigenvalues to decrease exponentially 
(for details see Theorem 3.30 below). 
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3.6.1. The cylindrical Dirac operator. To prove Theorem 3,17 we first recall a 
few properties of the cylindrical Dirac operator Dcyi := (j{du + B) on the infinite 
cylinder := (— oo,+oo) x E. A special feature of the cylindrical manifold E^^ 
is that we may apply the theory of Sobolev spaces exactly as in the case of The 
point is that we can choose a covering of the open manifold E^j by a finite number 
of coordinate charts. We can also choose a finite trivialization of the bundle • 
Let be such a trivialization, where : S\u, VI, x is a bundle 

isomorphism and an open (possibly non-compact) subset of Let {/^} be a 
corresponding partition of unity. We assume that for any l the derivatives of the 
function fi^ are bounded. 

Definition 3.19. We say that a section (or distribution) s of the bundle S 
over E^j belongs to the p-th Sobolev space 7f^(E^f, 5), p € M, if and only if /^ • s 
belongs to the Sobolev space 7Y^(E^;C^) for any l. We define the p-th Sobolev 
norm 

where denotes the Laplacian on the trivial bundle VI. x C x C^, 
Lemma 3.20. 

(a) For the unique self-adjoint extension of Dcy\ {denoted by the same symbol) 
we have 

Dom(Z)cyi)=H'(Sc^,;5). 

(b) Let Ai denote the smallest positive eigenvalue of the operator B on the manifold 
E. Then we have 

{{D,yifs;s)>\l\\sf 

for all s E Dom(Dcyi); and for any fi G (— Ai, +Ai) the operator 
D,yi-fx:W{^TyuS)^LH^ryuS) 
is an isomorphism of Hilbert spaces. 

(c) Let TZcyfip) denote the inverse of the operator Dcy\ — /x. Then the family 
{7^cyi(/x)}^G(-Ai,Ai) ^-5 a smooth family of elliptic pseudo- differential operators 
of order —1. 

Proof, (a) follows immediately from the corresponding result on the model 
manifold To prove (b) we consider a spectral resolution {(fk^ ^k}kez\o of 
L^(E; 5) generated by the tangential operator B. Because of (3.8), we have X-k = 
— Afc. We can assume = (j(pk for k e N. We consider a section s belonging 
to the dense subspace C'^(E^^;*S') of Dom(Dcyi), and expand it in terms of the 
preceding spectral resolution 

s{u,y) = fk{u)<pk{y)- 

fcez\{o} 
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Since (i^cyi)^ = — we obtain 

(£>cyl)^S = {Xlfk - fk)Vk, 
k 

hence 

/ oo 

{^‘Ifkiu) - fk{u))fk{u)du 

poo 

>>^l\\sf-Y fki^)Mu)du 

k d-oo 

POO 

= A?||sf + 5^ / f'k{u)fUn)du>XUsf. 

It follows that (i^cyi)^ (and therefore Dcyi) has bounded inverse in S) and, 

more generally, that (Dcy\)^ — is invertible for fi G (— Ai, Ai). 

To prove (c) we apply the symbolic calculus and construct a parametrix S 
for the operator Dcyb an elliptic pseudo-differential operator of order —1 such 
that SDcyi = / + T, where T is a smoothing operator. Thus = S — TD~J^. The 
operator T is a smoothing operator, hence is an elliptic pseudo-differential 
operator of order —1. The same argument can be applied to the resolvent T^cyi(M) = 
(Dcyi ~ for arbitrary jjL G (— Ai, Ai). The smoothness of the family follows by 
standard calculation. □ 

3.6.2. The part manifolds with half-infinite cylindrical ends. In order to prove 
Theorem 3.17 we need to refine the preceding results on the infinite cylinder to 
the Dirac operator, naturally extended to the manifold = ((— oo, 0] x E) UM 2 
with cylindrical end. Let (7^(M^;5) denote the space of compactly supported 
smooth sections of S over M^. Then 

( 3 . 22 ) s) - L\M^- S) 

is symmetric. Moreover, we have 

Lemma 3.21. Let s G C°^{M^;S) be an eigensection ofV^. Then there exist 
(7, c> 0 such that, on (— oo,0] x E, one has |s(u, 2/)| < Ce^'^. 

Proof. Let {<pk^ ^k}kez\o ^ spectral resolution of the tangential operator 
B. Because of (3.8) we have A_/e = —Xk and we can assume that ip-k = crpk for 
A: G N. Then 

(3.23) = ^(</2fc±fT(/7fc),±Afc|^^^ 

is a spectral resolution of the composed operator aB on E. Notice that we have 

(3.24) and cr</?- = >p+ . 

Let s € S) and 

(3.25) = ^i'>P 
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with ^ G M. We expand 5|(_oo,o]xs in terms of the spectral resolution of aB just 
constructed: 

oo 

s{u, y) = Y^ fk{u)ipt (y) + SfcHv’fc {y) ■ 

k=l 

Because of (3.23), (3.24), and (3.25) the coefficients fk,9k must satisfy the system 
of ordinary differential equations 



/ Xk d/du 
\-d/du -Xk 




or, equivalently, 

9k) \9k 



with A 



0 

M ^k 



+ Xk) 

0 



Since s G I/^, of the eigenvalues iby^A^ — of A, only those which are on the 
positive real line enter in the construction of s by solving the preceding differential 
equation. In particular, all coefficients fk,9k must vanish identically for Xk < ijl. 
Thus, 

(3.26) 

s{u,y)= Y), «fc (exp(y^ A| - y+ - ) 



and, in particular, 

k(u,2/)| < C'exp(^yA|~T^^) , M<0, 

for some constant (7, where Xk^ denotes the smallest positive eigenvalue of B with 
Xko > ImI- n 



In spectral theory we are looking for self-adjoint extensions of a symmetric 
operator. We recall: On a closed manifold, the Dirac operator is essentially self- 
adjoint] i.e. its minimal closed extension is self-adjoint (and therefore there do not 
exist other self-adjoint extensions) and it is a Fredholm operator. On a compact 
manifold with boundary, the situation is much more complicated. There is a huge 
variety of dense domains to which the Dirac operator can be extended such that 
it becomes self-adjoint; and there is a smaller, but still large variety where the ex- 
tension of the Dirac operator becomes self-adjoint and Fredholm (see Section 1.2.2 
above and Boo6-Bavnbek and Furutani [BoFu98]); a special type of self-adjoint 
and Fredholm domains are the domains specified by the boundary conditions be- 
longing to the Grassmannian of all self-adjoint generalized At iyah-Patodi- Singer 
projections. 

Now we shall show that the situation on manifolds with (infinite) cylindrical 
ends resembles the situation on closed manifolds. 

We recall the following simple lemma (see also Reed and Simon [ReSi72, 
Theorem VIII.3, Corollary, p. 257]. 
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Lemma 3.22. Let A he a densely defined symmetric operator in a separable 
complex Hilbert space 7i. We assume that range(A + il) is dense in H. Then A is 
essentially self-adjoint. 

Proof. Since A is symmetric, the operator A-\-iI is injective and the operator 
{A + il)~^ is well defined and bounded on the dense subspace range(A + il) of 
TL. Then the closure Ri of {A -\-iI)~^ has the whole space Ti as domain and Ri is 
bounded and injective. Now a standard argument of functional analysis (see e.g. 
Pedersen [Pe89], Proposition 5.1.7) says that the inverse R~^ of a densely defined, 
closed, and injective operator Ri has the same properties. Thus our R~^ is closed; 
and by construction it is the minimal closed extension of A-\-iI. Therefore, R~^ —il 
is symmetric and the minimal closed extension of A, hence self-adjoint and equal 
A\ □ 

We apply the lemma for H — and take for A the operator of 

(3.22). To prove that the range (P^ -\-iI){C^[M^\ S)) is dense in S) we 

consider a section s G S) which is orthogonal to {T>^ -\-iI){C^{M^; S')); 

i.e. the distribution — il)s vanishes when applied to any test function, hence 

(3.27) - il)s = 0. 

Since T>^ — i is elliptic, by elliptic regularity s is smooth at all interior points, that 
is for our complete manifold in all points. On the cylinder (— oo, 0] x H we expand 
s in terms of the eigensections of the composed operator aB on S. It follows that 
s satisfies an estimate of the form 

(3.28) |s(u,?/)| < {u,y) G (-oo,0] x E, 

for some constants C, c > 0 (according to Lemma 3.21). On the manifold with 
cylindrical end of finite length R we apply Green’s formula and get 

(3.29) s^) - (s^; V^s^) = - [ dy, s|{_h}xe), 

where denotes the restriction of s to the manifold with boundary {~R} x E. 
For ^ oo, the right side of (3.29) vanishes; and the left side becomes 2z |s|^ by 
(3.27). Hence s = 0. Thus we have proved: 

Lemma 3.23. The operator (3.22) is essentially self-adjoint. 

We denote the (unique) self-adjoint extension by the same symbol and 
we define the Sobolev spaces on the manifold as in Definition 3.19. Once again, 
the point is that manifolds with cylindrical ends, even if they are not compact but 
only complete, are like the infinite cylinder sufficiently simple to be covered by a 
finite system of local charts. Clearly 

Dom(P^) = H}{M^]S) and 

is bounded. There are, however, substantial differences between the properties of 
the simple Dirac operator Dcyi on the infinite cylinder and the Dirac operator 
on the manifold with cylindrical end. For instance, from B the discreteness of the 
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spectrum and the regularity at 0 (i.e., 0 is not an eigenvalue) are passed on to 
Dcyi, but not to V^. Yet we can prove the following result: 

Proposition 3.24. The operator 

: Dom(P^) - ^ L^{M^;S) 

is a Fredholm operator and its spectrum in the interval (— Ai, Ai) consists of finitely 
many eigenvalues of finite multiplicity. Here Ai denotes the smallest positive eigen- 
value of B. 

Remark 3.25. Actually, using more advanced methods one can show that the 
essential spectrum of is equal to (— oo, — Ai] U [Ai, oo) (see for instance Muller 
[Mu94, Section 4]). 

Before proving the proposition we shall collect various criteria for the com- 
pactness of a bounded operator between Sobolev spaces on an open manifold. Let 
X be a complete (not necessarily compact) Riemannian manifold with a fixed 
Hermit ian bundle. Recall the three cornerstones of the Sobolev analysis of Dirac 
operators for X closed. 

Rellich Lemma: The inclusion 7^^(X) C L^(X) is compact. 

Compact Resolvent: To each Dirac operator V we have a parametrix IZ 
which is an elliptic pseudo-differential operator of order — 1 with principal 
symbol equal to the inverse of the principal symbol of T>. So 7^ is a 
bounded operator from L‘^{X) to H^{X)^ and hence compact in L^(X). 
In particular, for fj, in the resolvent set the resolvent is compact 

as operator in L‘^{X). 

Smoothing Operator: Any integral operator over X with smooth kernel 
is a smoothing operator, i.e. it maps distributional sections of arbitrary 
low order into smooth sections. Moreover, it is of trace class and thus 
compact. 

In the general case, i.e. for not necessarily compact X, the Rellich Lemma 
remains valid for sections with compact support. A compact resolvent is not at- 
tainable, hence the essential spectrum appears. Operators with smooth kernel 
remain smoothing operators, but in general they are no longer of trace class nor 
compact. We recall: 

Lemma 3.26. Let X he a complete {not necessarily compact) Riemannian man- 
ifold with fixed Hermitian bundle. Let K he a compact subset of X. 

(a) The injection ?^^(X) C T^(X) defines a compact operator when restricted 
to sections with support in K. In particular, for any cutoff function \ with 
support in K and any hounded operator TZ : L^(X) ~^H}{X) the operator \LZ 
is compact in L^(X). 

(b) Let T : L^(X) ^ L^(X) he an integral operator with a kernel k{x,y) G I/^(X^). 
Then the operator T is a hounded, compact operator {in fact it is of Hilbert- 
Schmidt class). 
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(c) Let T : L^(X) be a bounded compact operator and Ti' a closed 

subspace of L^(X), e.g. H' \= L^(X') where X' is a submanifold of X of 
codimension 0. Assume that T{1~C) C LC . Then T|>^/ is compact as operator 
from H' to TC . 

Proof, (a) follows immediately from the local Rellich Lemma, (b) is the fa- 
mous Hilbert-Schmidt Lemma. Also (c) is well known, see e.g. Hormander [Ho85, 
Proposition 19.1.13] where (c) is proved within the category of trace class opera- 
tors. □ 

In general an integral operator T with smooth kernel is not compact even if 
either supp^ k(xyx') or supp^/ k{x^x') are contained in a compact subset K C X. 
Consider for instance on = (— oo,-hoo) x E an integral operator T with a 
smooth kernel of the form 

k{x,x') = x{x)d{x,x^), 

where d{x^x') denotes the distance and x is a function with support in a ball 
of radius 1 (and equal 1 in a smaller ball). Then T is not a compact operator 
on I/^(E^^): choose a sequence {s^} of functions of norm 1 and with supps^ 
contained in a ball of radius 1 such that d(suppx, supp = n. Then for any n 
we have |Ts^| > Cn. Thus T is not compact, in fact not even bounded. 

For the bounded resolvent (see Lemma 3.20) 

we have, however, the following corollary to the preceding lemma. It provides an 
example of a compact integral operator on an open manifold with a smooth kernel 
which is compactly supported only in one variable. 

Corollary 3.27. Let \ '0 be smooth cutoff functions on E^^ with sup- 

port contained in the half-cylinder (— oo,0) x E. Let suppx be compact Then the 
operators x^cyiV^ cb'^d 'iflZcyxX compact in L^(E^^; 5). 

Proof. The operator x^cyi^^ is compact according to the preceding lemma, 
claim (a). Its adjoint operator is V^77.cylX^ since 77-cyi is self-adjoint. Thus it is also 
compact (even if its range is not compactly supported). □ 

3.7. The estimate of the lowest nontrivial eigenvalue. In this section 
we prove Theorem 3.17. Recall that the tangential operator B is assumed to be 
nonsingular and that Ai denotes the smallest positive eigenvalue of .B. So far, we 
have established that: 

(I) The operator Bcyi on the infinite cylinder E^^ has no eigenvalues in the 
interval (— Ai,-hAi). 

(II) The operator T>^ on the manifold with infinite cylindrical end has 
only finitely many eigenvalues in the interval (— Ai,-1-Ai), each of finite 
multiplicity. 
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We have to show that: 

(III) The nonvanishing eigenvalues of {V 2 ) p> bounded away from 0 by a 
bound independent of R. 

Proof of Theorem 3.17. The idea of the proof is the following. We define 
a positive constant /ii independent of R. Then let R he a positive real (more 
precisely R> Rq for a suitable positive Rq), and s G S) any eigensection 

with eigenvalue ji G (— Ai/a/2, +Ai/\/2), i.e., s G Dom(X>^)p^, i.e., 

P>(s\{-R}x^) =0 and T)^s = ns. 

Then we show that jjp > /ii/2 for a certain real /ii > 0 which is independent of R 
and s. A natural choice of /ii is 

/ii gH\M^-S) and^±KerD^|. 

Note that by (II) above (Proposition 3.24), KerX>^ is of finite dimension. We shall 
define a certain extension G S) of s. 

The reasoning would be easy, if we could extend s to an eigensection of 
on all of . Then it would follow at once that the discrete part of the spectrum 
of is not empty, /i belongs to it, is the smallest eigenvalue > 0, and hence 

we would have fj? > /txi/2 as desired. In general, such a convenient extension of 
the given eigensection s cannot be achieved. But due to the spectral boundary 
condition satisfied by s in the hypersurface {— i^} x E, the eigensection s over 
can be continuously extended by a section over {— 00 ,—R] x E on which the Dirac 
operator vanishes. By construction, both the enlargement a of the norm of s by 
the chosen extension and the cosine, say j3, of the angle between and KerD^ 
can be estimated independently of the specific choice of s and fi. It turns out that 
they both decrease exponentially with growing R. 

Let {si, . . . , 5q} be an orthonormal basis of KerPg^ set 

J = 1 

Clearly, the section s belongs to S) and is orthogonal to KerD^. 

I ^oo~| 2 

Hence, on the one hand, ' ,^.2 > Mi. On the other hand, we have by con- 

struction Finally, we shall prove that 

(3.30) |sl -> 1 as -> 00 . 

Then the estimate 

follows for sufficiently large R. Since we have assumed that we also have 

Ml < Af, hence mi belongs to the discrete part of the spectrum of (T>^)^ and, by 
the Min-Max Principle (see e.g. [ReSi78]), it must be its smallest eigenvalue > 0. 
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Thus, to prove the Theorem 3.17 we are left with the task of first constructing 
a suitable extension s of s and then proving (3.30). 

We expand o]xS in terms of a spectral resolution 

A/e; —Xk}keN 

of L^(E; *9) generated by B: 

oo 

s{u,y) = Y, fk{u)>fik{y) + 9k{u)(Tipk{y) ■ 

k—1 

Since a{du + ^)s|[_h,o]xs — 0? th® coefficients must satisfy the system of ordinary 
differential equations 

(3.31) r.)- 

Moreover, since P>s|{_^}xs = 0? we have 

fk{—R) = 0 for any A; > 1. 



Thus, for each k the pair {fk^ 9k) is uniquely determined up to a constant a^. More 
explicitly, since the eigenvalues of are ±(A| — a suitable choice of the 

eigenvectors of A/^ gives 

fk{u) = ak , ^ sinh i/a| - jj?{R + u), 



gk{u) = flfc ( cosh Jxl~y?{R + u)+ ^ sinh(A| - + m)] . 

We assume \s\j ^2 = 1- Then we have, with v := (A| — + u): 

oo 



> [ \s{u,y)\‘^ dudy f {\fk{u)\‘^ + \gk{u)\^)du 

J[-r,o]xj: 



sinh V 






+ cosh^ V + 2 



Afc 



A? 



(A| - 



cosh V sinh v + -r , ^ sinh^ v ] dv 



k=l 



XI 









sinh{2{\l - fi^y/^R) 






+ 



xi 






cosh\{Xl-9^ 
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Since A| > Af > 2fi^ we have 2(A| — > \/2\k > Xk- Moreover, we have 

for all A: > 1 



> _/? + sinh(2(A? - 

\f2 

> —R + — Ai sinh(\/2Aii?) > 0, 

8 

if > Rq for some positive Rq which depends only on Ai and not on s and k. 
Thus, for any k the sum in the braces can be estimated in the following way: 



\ / 4 4 



Hence, we have 



(3.32) <4.. 

k=l 

Note that the preceding estimate does not depend on R (provided that R > Rq), 
k or the specific choice of 5, and that Rq only depends on Ai. 

According to (3.32) the absolute value of the coefficients ak is rapidly decreas- 
ing in such a way that, in particular, we can extend the eigensection s of , 
given on to a continuous section on by the formula 



5-(rr) 



s{x) for X G 

for X ^ (u,y) G (-oo, -r] x E. 



By construction, is smooth on \ ({— x E) and belongs to the Sobolev 
space It follows from (3.32) that 



(3.33) 






IL2 



oo 

+ / < 

k=i 



2Xk(R-\-u^ 



d« = i + ^Kp_ 



k=l 



^ k=l ^ ^k=l ^ 

< 1 + 

Ai 



Next, let ^ G KerP^^ assume that |4^| = 1. By (3.26), on (— oo,0] x E 
the section ^ has the form 

oo 

'^{u,y) = '^he^’^^G{y)(pk{y) 

k=l 



(3.34) 
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oo „o oo . 

|6fc|V^''“dw = ^ — < OO. 



Set I := Then I satisfies the equations 



V^l = 0 and P>(/|{_r}xs) = 0. 

Hence, I belongs to KerX>^p^. This implies the following equality: 

[ (s'^(x); ^(x)) dx = - [ (P^s®°(x); ^(x)) dx 

= - [ (s°^{x)-T>2l{x)) dx - - [ (as'^{-R,y)]l{-R,y)) dx. 

M Jm^ M ds 

On the other hand, 

— oo, — rlxE 1,-^n 



Therefore, 






Hence, we have proved: 



Lemma 3.28. Any eigensection s G 7{^{M^;S) ofV^p^ with eigenvalue y G 
(-Ai/v^,Ai/V2) can be extended to a continuous section on which is 
smooth on \ {{—R} x E) and belongs to the first Sobolev space R}{Mf^\S). 
Moreover, the enlargement of the norm of s by the extension and the cosine of the 
angle between andKevV^ are exponentially decreasing by (3.33) and (3.35). 



The final step in proving the Theorem 3.17 follows at once from the preceding 
lemma. We recall: By definition of /ii we have / \^ > pL\ and by construc- 
tion of s we have — jjf. Thus, we have (jf > pLi. To get the desired 

bound ijf > )Ui/2, it remains to show that |s]^ >1/2 for sufficiently large R. 

Since s is the orthogonal projection of onto (KerD^)-*- and the basis 
{si, . . . , Sq} of KerV^ is orthonormal, we have 

1^2 ^ |,oc|2 _ ^ ,^|2 < 1 ^ 2 -A,fi _ ^i^^oo, ^ ,^|2 ^ 

J = 1 ^ 

Thus, Theorem 3.17 follows from 

- 1| < + gCie-2^‘^ < 

Al 

□ 
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We finish this section by proving the asymptotic estimate (3.20). Recall that 
8^{t;x^x') denotes the kernel of the operator , where de- 

notes the Dirac operator over the manifold with the spectral boundary con- 
dition at the boundary {—R} x D. Then we have: 



Lemma 3.29. 

f ^ f TrE^{t]x,x)dx = 0{e~^^). 

J^/R vt Jm^ 

Proof. For any eigenvalue ^ 0 of R > 0 sufficiently large 

{R‘4 > 1, where cq denotes the lower uniform bound for /i^ of Theorem 3.17) we 
have 



(3.36) 



pOO -1 pOO -j pOO 

/ — dt< — dt= e~^ dr 

J^/r yt Jy/R yt J|ju|Ri/4 

poo 

< / 

J\p.\R^ 



l^jpl/4 L 2 J |/i|Rl/4 



2^ 



^Vr 



which gives 

r4/ 

JVr yt Jm^ ^ 



^ J^Vi Jm^ 



r"' dt 






fi^o (1^0 

< Cl Tr )") < C 2 \o\{M^) 

< C3 < C-i e-^“^ . 



Here we have exploited that the heat kernel x,x') of the operator T> 2 P> 
be estimated by 

|e^(t; X, x')| < 
according to (3.13). Thus, 



(3.37) 



Tr 




|Tre^(l; x, x)\ dx < 




dx. 



□ 
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3.8. The spectrum on the closed stretched manifold. Thus far, we 
have proved the asymptotic equation 

1 Hi f 

-n TvS^{t\x,x)dx + 0{e-‘^^) =riT:,R ( 0 ) 

Jo yt Jm^ ’ > 

as R ^ oo. It follows that 

Urn rjR = lim (rj-pn (0) + r]pR (0)) , 

R—*oo R—^oo \ / 

where 

77r := T Z' Tr£^{t-X,x)dx. 

Jo yt Jm^ 

To prove Theorem 3.8, we still have to show (3.21), i.e., that we can extend the 
integration from \/S to infinity: 

[ TvS^{t;x,x) dx — as R ^ oo. 

Recall that x, x') denotes the kernel of the operator on the closed 

stretched manifold 

Formally, our task of proving the preceding estimate is reminiscent of our 
previous task of proving the corresponding estimate for the kernel S^{t;x^x') of 
the operator ^ 2 ,p>j Lemma 3.29). Both integrals are over the same 

prolonged compact manifold with boundary {— R} x E. However, the methods 
we can apply are different: In the previous case, we had a uniform positive bound 
for the absolute value of the smallest nonvanishing eigenvalue of the boundary 
value problem for sufficiently large R. 

As mentioned above in Remark 3.18, such a bound does not exist for the Dirac 
operator on the closed stretched manifold M^. Moreover, for the spectral 
boundary condition we shall show 

dimKerD^^P^ = dimKerD 2 ,p> and '^v^p (^) = 'Hv -2 (0) 

for any R (see Proposition 3.40 below). For on the contrary, the dimension 
of the kernel can change and, thus, ? 7 p>r can admit an integer jump in value as 
R oo. This is due to the presence of ‘small’ eigenvalues created by solutions 
of the operators and on the half- manifolds with cylindrical ends. We use a 
straightforward analysis of small eigenvalues inspired by the proof of Theorem 3.17 
to prove the following result. 

Theorem 3.30. There exist Rq > 0 and positive constants ai, a 2 , anda^, such 
that for any R> Rq, the eigenvalue pi of the operator is either hounded away 
from 0 with a\ < \pi\, or it is exponentially small \pi\ < a 2 e~^^^. Let denote 
the subspace of L‘^{M^;S) spanned by the eigensections of corresponding to 
the exponentially small eigenvalues. Then dimW^ = q, where q = dim(KerD^) + 
dim(KerP^). 
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Recall from Proposition 3.24 that the operator acting on the first Sobolev 
space 5), is an (unbounded) self-adjoint Fredholm operator in S) 

which has a discrete spectrum in the interval (— Ai,+Ai) where Ai denotes the 
smallest positive eigenvalue of the tangential operator B. Thus, the space KerX>^ 
of solutions is of finite dimension. 



To prove the theorem we first investigate the small eigenvalues of the operator 
and the pasting of solutions. Let R > 0. We reparametrize the normal 
coordinate u such that = M\ U ((— R, 0] x E) and = ([0,-R) x E) U M 2 , 
and introduce the subspace C spanned by solutions of the 

operators . We choose an auxiliary smooth real function /^ — //^ U on M^ 
with f^ — 1 outside the cylinder [—R,R] x E, and where is a function of the 
normal variable u on the cylinder. Moreover, we assume f^{—u) = f^{u) (i.e., 
and that is an increasing function of u with 



f^{u) 



0 for 0 < u < j, 

1 for ^ < u < R. 



fiP fR 

We also assume that there exists a constant 7 > 0 such that | {u)\ < ^R~^ . If 

Sj G 5), we define si Ujh S 2 by the formula 



(si UfR S2) (x) := 



fi'{x)si{x) for X G M/^, 
f^{x)s 2 {x) for X G M^. 



Clearly, we have 

Si UfR S 2 = Si UfR 0 + OUfR S 2 , 

(3.38) T>^(si UfR S 2 ) = (V^si) UfR (V^S 2 ) + si UgR S 2 , and 
|siUj-RS2| = |siUy-R0| T jOUyRS2| , 

0 

where := U g^ with gf(u^y) = a{y)-^{u,y) and ] • | denotes the norm 
on the manifold M^. 



Definition 3.31. The subspace c is defined by 

span{si UfR S 2 \ Sj G KerU^}. 



Let { 51 ^ 1 , . . . , si^q^} be a basis of KerHi^ and let {s 2 ,i, . . . , 52 ,^ 2 } t>e a basis of 
KerD^. Then the q = qi-\-q 2 sections Ujr 0} U {OUjr 52 , 172 } form a basis of 
V^. We want to show that approximates the space of eigensections of 
corresponding to the ‘small’ eigenvalues, for R sufficiently large. We begin with an 
elementary result: 

Lemma 3.32. There exists Rq, such that for any R> Rq and any s G the 
following estimate holds 

\V^s\ < e“^i^|s| . 
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Proof. It suffices to prove the estimate for basis sections of Thus, let 
s = Si UfR 0 with Si e KerPf^. By (3.38) we have 



(3.39) 



V^s{x) = 



0 for X G Ml U M 2 , 

y) ^ y) e[-R,R]xT.. 



Here ff- is continued in a trivial way on the whole cylinder [— R] x S. Now, 
Si is a solution of hence si{u,y) = V^fc(y) on this cylinder 

where {(^/c, A^; — Afc}A;6N is, as above, a spectral resolution of T^(Z); S) for B. 

We estimate the norm of V^s: 

|2 






du 



Si 






=/- 



du 



\ck?e ^(■^+“^^*(v3fc(2/);¥>fc(y))d2/dM 

|Cfc |2g-2(fl+u) Afc 2 
k 

r 



e 2 " 



2Afc 



~R\k 



< 2_ V = lcJ2 < ^ V 

- i?2 2^ 2Afc ' ''' - R2 2^ 

k 



TL 

R? 






2A, 



On the other hand, we have the elementary inequality 

r-R+i 

\2 

isi[u,yj 

-R Jt. 

' 1 — 



— RT 1 n 

/ kiN,y)P 

-R JT. 



dydu 






\ck[ 



2Xk ’ 



with 0 < d < 1 — e Thus, we have the following estimate for any s G of 
the form si UyR 0 and for sufficiently large R 



For s = 0 Uj-R S 2 , we estimate the norm of Vrs in the same way, in view of the 
fact that S 2 has the form S 2 {u,y) = a{y)ipk{y) on the cylinder. □ 
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Let {\k]'^k} denote a spectral decomposition of the space S) gener- 

ated by the operator V^. For a > 0, let Pa denote the orthogonal projection onto 
the space Ha ’= spa,n{'ipk \ |A/c| > a}. 

Lemma 3.33. For sufficiently large R, we have the estimate 

|(/ - Pg-HAi/4) s| < |s| jor all s e V^. 



Proof. We represent s as the series s = aki^k- We have 

;^2>e-HAi/2 ;^2>g-flAi/2 

k 

^^RX,/ 2 e-RX. |^| 2 ^g-RA,/ 2 |^| 2 _ 




□ 



Proposition 3.34. The spectral projection P^-rx-^/a restricted to the subspace 
is an injection. In particular, has at least q eigenvalues p such that \p\ < 
g-RAi/4^ i(;/iere q is the sum of the dimensions of the spaces KerX>^ of L‘^ solutions 
of the operators and . 

Proof. Let s G V^, and aissume that Pg-HAi/4(s) = 0. We have 

RXl 1 

|s| = K-^- A-«^i/ 0 s| <e 2 |s|<2kl- 

for R sufficiently large. □ 



The proposition shows that the operator has at least q exponentially small 
eigenvalues with corresponding eigensections, which we can approximate by past- 
ing together solutions. Now we will show that this makes the list of eigenvalues 
approaching 0 as P — > +oc complete. 

Let be an eigensection of corresponding to an eigenvalue /x, where \p\ < 
Ai. As in the proof of Theorem 3.17, we expand V^|[_r,k]xe in terms of a spectral 
resolution 

{pk, Afc; crpk, — A/c}/e€N 

of P) generated by B: 

00 

ip{u, y) = fk{u)(pk{y) + gk{u)a^pk , 

fc=l 

where the coefficients satisfy the system of ordinary differential equations of (3.31) 




Afe M ^ 
) 



= Aa: 



fk 

9k 



with Ak := 
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For the eigenvalues — fj? of Ak and the eigenvectors 



A/e + \/^l “ 



and 



+ \/^fc - / ’ 

we get a natural splitting of 4’{u, y) in the form y) = y) + {u, y) with 

’4>+{u,y) = + yj \l - + y.(T{y)ipk{.y)^ , 

■tp-{u,y) = |p¥’fc(y) + (Afc + V^A| - y.'^^cr{y)<pk{y)^ ■ 

Then we have the following estimate of the norm of xjj in the y direction 
on the cylinder; 

Lemma 3.35. Assume that |^| = 1. There exist positive constants Ci,C2 such 
that |«/'|{„}xi;| < cie“‘=2^ for -^R <u<^R. 

Proof. We have 

IV^K-R+rtKEl 



< e 



-2^\AF^ 



^ flfee I fk + 






xE 



In the same way we get |t/’|{/i-r}xs|^ < e • 

Let us observe that, in fact, the argument used here proves that 

|V'+|{r-}xs| < |V’+|{s}xe| and 

|V’-|{s}xe| < e *■’’ |V'-|{r}xE| 

for any —R<s<r<R. We also have another elementary inequality 

l'0|{r}xE| > |V^+|{r}xEl ~ 2 \'lp-\-\{r}xJ:\ |^-|{r}xE| • 

This helps estimate the norm of 'ip± in the y direction. We have 



> 



/ 



-H+l 



-R 
-R+l 



{u}xE| 



du 



~l R ~ ^ l^+K'‘}xs| |V’-|{«}xe|) 



du 



> |V’+|{-fl}xE 

- -RT 1 





|V’+|{-i?}xE| e"2«\AF^|^_ 
-R 



|{R}xE 



du 



> |^+|{-R}xe| - 2e M 



xE 
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In the same way we obtain 

> lV^-|{H}xsl - IV^-llRtxsl • 

We add the last two inequalities and use 

2 Iv^+K-Rlxsl |'0-|{R}xs| < |V^+|{-R}xe| + 1V^-|{R}xs| 

to obtain 

2 \'4^f - ^ + |'0-|{r}xe| ) • 

This gives us the inequality we need, namely 

|V^±1{=fR}xe I ^ 4 . 

Now we finish the proof of the lemma. 

|V^|{tx}xs| = |^+|{u}xS + 

< 2 1^1 < cie“=^-^ 

for certain positive constants ci,C 2 when —jR<u<jR. □ 

We are ready to state the technical main result of this section. 

Theorem 3.36. Let denote an eigensection of the operator T>^ correspond- 
ing to an eigenvalue p, where \p\ < Ai . Assume that is orthogonal to the sub- 
space Pg-RAi/ 4 V^ C LP‘{M^] S). Then there exists a positive constant c, such that 
\p\ > c. 

To prove the theorem we may assume that = 1. We begin with an elemen- 
tary consequence of Lemma 3.33. 

Lemma 3.37. For any s G we have 



Proof. We have 

|(^;s)| = \{lp-,P^-RX,/4{s) + {s - P^^rx,/4s)))\ = |(V';Pe-«M/'‘(«))l 
< IV-I |Fe-RAi/4(s)| < |sl . 

□ 

We want to compare %l) with the eigensections on the corresponding manifolds 
with cylindrical ends. We use if to construct a suitable section on the manifold 
= ((-00. -R] X E) U M 2 . (Note the reparametrization compared with the con- 
vention chosen in the beginning of this chapter.) Let h : R be a smooth 

increasing function such that h is equal to 1 on M 2 and h is a function of the 
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normal variable on the cylinder, equal to 0 for u < and equal to 1 for < u. 
We also assume, as usual, that |f^| < for some constant 7 > 0. We define 






h{x)'ip{x) for X e M 2 



I 0 for X e (—CO, 0] X E. 

Proposition 3.38. There exist positive constants ci and C 2 , such that 
\{^PT■,s)\<c,e-^^^\s\ 

for any s G Ker . 

Proof. For a suitable cutoff function we have 



l(V'2°°;s)l = 



< 



/ ii’T ^i^)) dx = f {h{x)-ip{x); f^{x)s{x)) dx 

J Jm^ 

[ {‘ip{xy,fi{x)s{x)) dx + j {{l-h{x))ij){x)-,f 2 {x)s{x)) 

Jm^ Jm^ 



dx 



We use Lemma 3.37 to estimate the first summand: 

[ {■ip{x);f 2 {x)s{x))dx = f {ij{xy,{0UfR s) {x))dx 

Jm^ Jm^ 

= I (V'; 0 U/R s) I < 

We use Lemma 3.35 to estimate the second summand: 
f ((1 - h{x))ip{x)- f 2 (x)s{x)) dx 

Jm^ 

[ I ((1 - h.{x))ip{x); f^{x)s{x)) I dx 

[ K(1 - h{x))ip{x))\ \f^ix)s{x)\ dx 

Jm^ 

< “ h{x))ip{x))f dx^ |s| 

^ vio 



< 



< 



□ 



Proof of Theorem 3.36. Now we estimate /i^ from below by following the 
proof of Theorem 3.17. We choose {sfc}^^^^an orthonormal basis of the kernel of 
the operator Let us define 

_ Q2 

V> := ■02° - E 

k=l 
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Then 'll; is orthogonal to KerP^, and it follows from Proposition 3.38 that 

1^1 > ^ iV'n > K > 0, 

for R large enough, where k, is independent of R, of the specific choice of the 
eigensection i/;, and of the cutoff function h. Let denote the smallest nonzero 
eigenvalue of the operator Once again, it follows from the Min-Max Prin- 
ciple, that ( 'ip'^'ip) > We have 



= f \V^[h{x)'ip{x) (1 — h{x))'ip{x))\‘^ dx 

> f \T>^h{x)'il;{x)\^dx — j |T>^((1 — /i(x))'0(x)) p dx. 

It is not difficult to estimate the first term from below. We have 

JM^ 

We estimate the second term as follows: 

[ \V^{l-h{x)i}{x))f dx= [ \{l-h{x)){V‘^'i{j){x)-a{x)^{x)il;{x)\^dx 

JM^ J 

< (| m (1 - h(x))ip{x)\^ + 2\n{l - h{x))ip{x)\ + \a{x)^{x)i){x)\^'^ dx 

Now we use Lemma 3.35 successively to estimate each summand on the right side 
by This gives us 



f |X>^((1 — /i)'0)(x)|^ dx < cse 
Jm^ 

and finally we have pL^ > for R large enough. 



□ 



Theorem 3.30 is an easy consequence of Theorem 3.36. 



3.9. The additivity for spectral boundary conditions. In this section 
we finish the proof of Theorem 3.8. We still have to show equation (3.21): 

Lemma 3.39. We have 77^ = 0(e“^^) mod Z 'where 

1 r dt. 

Proof. It follows from Theorem 3.30 that we have ‘exponentially small’ eigen- 
values corresponding to the eigensections from the subspace and the eigen- 
values p bounded away from 0, with \p\ > ai , corresponding to the eigensections 
from the orthogonal complement of . First we show that we can neglect the 
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contribution due to the eigenvalues that are bounded away from 0. We are pre- 
cisely in the same situation as with the large t asymptotic of the corresponding 
integral for the Atiyah-Patodi-Singer boundary problem on the half manifold with 
the cylinder attached. Literally, we can repeat the proof of Lemma 3.29 by replac- 
ing T> 2 p^ by and the uniform bound for the smallest positive eigenvalue of 
T> 2 p^ by our present bound a\. Thus, we have 





For the last inequality see (3.36). A standard estimate on the heat kernel of the 
operator gives (as in (3.37)) the inequality Tr < 63 • Vol(M^) < 

which implies that 

POO -I 

(3.40) / ^Tr(l?^e-*®«l(wK)x) rfi < 

J^/R Vt ^ ^ 

This proves that the contribution from the large eigenvalues disappears as R ^ 00 . 
The essential part of 77 ^ comes from the subspace 




(3.41) 
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It follows from Theorem 3.30 that lim \/j,\ = 0. Thus, the last term in (3.41) 

R^oo 

is equal to 

(3.42) sign(P) := ^ sign{fi) 

plus the smooth error term which is rapidly decreasing as R oo. □ 



Thus we have proved Theorem 3.8. In particular, we have proved 
lim 77 i,r( 0)= lim (0 )+^d«p (0)| mod Z. 

R->-oo R—^oo \ j 

To establish the true additivity assertion of Corollary 3.9, we show that the pre- 
ceding eta invariants do not depend on R modulo integers. 



Proposition 3.40 (W. Miiller). The eta invariant (0) ^ inde- 

pendent of the cylinder length R. 

Proof. Near to the boundary of we parametrize the normal coordinate 
u G [-R, 1) with the boundary at u = —R. First we show that dimKerP|^P^ is 
independent of R. Let s G Ker , namely 

(3.43) s^C^{MtS), V§s = 0, and P>(s|{_fi}x 5 :) = 0. 

As in equation (3.26) (and in equation (3.34) of the proof of Theorem 3.17) we 
may expand 5|[_p o]xE in terms of the eigensections of the tangential operator B: 

oo 

s(u,y) = y^e^'=“a(y)(^fc(j/). 

k=l 

Let R' > R. Then s can be extended in the obvious way to s G Ker , and the 
map s s defines an isomorphism of KerP^P^ onto KerP^p^. Next, observe 
that there exists a smooth family of diffeomorphisms fp : [0, 1) ^ [— P, 1) which 
have the following cutoff properties 



/r(^) = 



u for I < u < 1, 
u-\- R for0<u<^. 



Let 'ipp : [0, 1) X E ^ [— P, 1) x E be defined by 'iPr{u, y) := {fR{u),y), and extend 
'ipR to a diffeomorphism ipp : M 2 in the canonical way, i.e., \jjp becomes 

the identity on M 2 \ ((0, 1) x E). There is also a bundle isomorphism which covers 
ipp. This induces an isomorphism : C^{M^; S) C^{M 2 \ S). Let 

^:=rRoV^o{rn)-^. 



Then {P^}r is a family of Dirac operators on M 2 , and P|^ = cr{du + B) near E. 
We pick the self-adjoint extension defined by DomP^p^ t/^p ^DomP|^p^^. 
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Hence, 

is) (s) and KerD^P = V-fl KerD^P 

^2,P> 

In particular, dimV^p^ is constant, and we apply variational calculus to get 




where Cm{R) is the coefficient of t in the asymptotic expansion of 

oo 

j-o 



with Ar := ^ •“ dimM. Now let Sp denote the circle of radius 2R. 

We lift the Clifford bundle from S to the torus Tr := 5^ X E. We define the action 
of m : C^{Tr,S) -> C'^(Th, 5) by ^ - a{du + B). Since Cm{R) is locally 
computable, it follows in the same way as above that 



But a direct computation shows that the spectrum of is symmetric. Hence 
T]^{s) = 0 and, therefore, Cm{R) =0. □ 



In the same way we show that t]x,r is independent of R. This proves the 
additivity assertion of Corollary 3.9. In fact, we have proved a little bit more: 

Theorem 3.41. The following formula holds for R large enough 
f?v(0) = (0) + riD^ p^ (0) + signp(P), 

where sign^(P) sign(/x); see (3.42). 

\iu\<ai 

Theorem 3.41 has an immediate corollary which describes the case in which 
our additivity formula holds in R, not just in R/Z. 

Corollary 3.42. //KerPf = {0} = KevV^, then 

V-oiO) = (0) + t/d, p^ (0). 
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Index theory of Dirac operators on manifolds 
with corners up to codimension two 

Paul Loya 



Abstract. In this expository article, we survey index theory of Dirac oper- 
ators using the Gauss-Bonnet formula as the catalyst to discuss index for- 
mulas on manifolds with and without boundary. Considered in detail are the 
Atiyah-Singer and Atiyah-Patodi-Singer index theorems, their heat kernel 
proofs, and their generalizations to manifolds with corners of codimension 
two via the method of ‘attaching cylindrical ends’. 



1. Introduction: The Gauss-Bonnet formula and index theory 

The purpose of this paper is to serve as an overview of index theory for Dirac 
operators on manifolds with corners with emphasis on the 6-geometry approach of 
Melrose [59] to such a theory. The underlying theme of this paper is that index 
formulas are basically generalizations of the classical Gauss-Bonnet formula. 

This paper is organized as follows. First, to understand what index theory is 
and why it is important, we recall the Gauss-Bonnet formula. In particular, we 
interpret the Gauss-Bonnet formula as an index formula. This interpretation leads 
us naturally to the Atiyah-Singer index formula for Dirac operators on manifolds 
without boundary published in 1963 [ 6 ], which we discuss in Section 2. In 1973, 
Atiyah, Patodi, and Singer in the seminal paper [4] extended the Atiyah-Singer 
formula for Dirac operators to manifolds with smooth boundary. We present this 
formula from the ‘cylindrical end’ point of view in Section 3. We also reformulate 
the Atiyah-Patodi-Singer (henceforth APS) problem using the language and no- 
tation of the 6- geometry. In Section 4, we present a 6- geometric proof of the APS 
index formula. Currently, there is no direct analog of the ‘APS index formula’ for 
manifolds with corners of codimension two, except under certain restrictive non- 
degeneracy conditions [51], [67], which we discuss in Section 5. However, in joint 
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Figure 1. The manifold Pq, where — tt < ^ < tt, is the unit 
sphere with a wedge removed. 

work with Melrose [53] , these restrictions are removed by perturbing Dirac opera- 
tors using 6-smoothing operators. We discuss such perturbations and the resulting 
index formulas for the perturbed Dirac operators in Section 6. 

Finally, I thank Gerd Grubb, Rafe Mazzeo, and Richard Melrose for helping 
to make this research possible. I also thank the referees for valuable suggestions. 

1.1. The classical Gauss-Bonnet formula. Let M be a compact, oriented, 
two-dimensional Riemannian manifold without boundary. Then the Gauss-Bonnet 
theorem states that 

(Ll) S I 

where x{^) is the Euler characteristic of M and K is the Gaussian curvature 
of M. The interesting aspect of the Gauss-Bonnet formula is that the left-hand 
side is a topological/combinatorial object while the right-hand side is a geometric 
object.^ This formula was proved by Bonnet in 1848, but is attributed also to 
Gauss because he proved a special case of it earlier. See [68, Ch. 8] for a proof of 
the Gauss-Bonnet formula. 

A natural question to ask is: Does the Gauss-Bonnet formula continue to hold 
if M has a smooth boundary, or more generally, if M has corners; that is, has a 
crooked boundary? To answer this question, we consider a concrete example. Cut 
out a wedge from the unit sphere producing the manifold where — tt < ^ < tt, 
as shown in Figure 1. This manifold is an example of a manifold with corners 
of codimension two. Let us check if (1.1) holds verbatim for Pq. Note that Pe 
is topologically equivalent to a disk and hence to a triangle and so has Euler 
characteristic equal to one (since the number of vertices — edges + faces 1 for a 
triangle). Since the Gaussian curvature of the unit sphere is one, Jp^ K = Area(P6i). 
Thus Jp^ K changes with 0: It is approximately 47t when 0 is close to — tt and it 
decreases to 0 as ^ approaches +7 t. Hence, 

x(Pe) ^ [ K for general 0. 

27t Jp^ 

Thus the Gauss-Bonnet formula (1.1) does not hold verbatim when M has corners. 
Intuitively, one might guess that the formula does not hold because of the presence 

^The right-hand side of (1.1) turns out to be topological as well since —K/2'k defines the 
Chern class of M. 
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of the boundary and corners. In fact, one can verify directly that the following 
formula does hold: 

(L2) 

The angle 26 is called the total exterior angle of the corners. This formula is a 
special case of the general Gauss-Bonnet formula: 

Theorem 1.1 (Gauss-Bonnet, 1878). Given a compact, oriented, two-dimen- 
sional Riemannian manifold M with corners, we have 

+ -^{total geodesic curvature of dM) 

ZTT 

-h — {sum of the exterior angles at the corners). 

Here, the geodesic curvature of dM measures the deviation of the smooth 
components of dM from being geodesics. There is no middle term in the formula 
(1.2) since the smooth components of dPg are great circles, which are geodesics 
on the sphere. Hence, the total geodesic curvature of dPg is zero. 

The Gauss-Bonnet formula in (1.3) is very beautiful as it bridges topology, 
geometry, and now linear algebra: The left-hand side belongs to combinatorial 
topology while the first two terms on the right are geometrical and the last term is 
linear algebraic since it has to do with angles between vectors at the corners. 
Functional analysis also comes into the picture when we interpret the Gauss- 
Bonnet formula as an index formula. We remark that comparing the Gauss-Bonnet 
formula (1.1) for a manifold without boundary to the general formula (1.3), we see 
that the second and third terms on the right in (1.3) can be thought of as correction 
terms coming from the smooth boundary components and corners respectively, 

1.2. The Gauss-Bonnet formula as an index formula. We now explain 
how the Gauss-Bonnet formula can be interpreted as an index formula. We first 
need to introduce the Gauss-Bonnet operator. Let M be a compact, oriented, 
two-dimensional Riemannian manifold without boundary. Let 

be the exterior derivative, where C^{M, A*) denotes the space of smooth fc-forms 
on M, and let 

d* : A'^+i) ^ A'^) 

be the adjoint of d with respect to the natural inner product on fc-forms given 
by integration with respect to the Riemannian volume form. Let A"^" = A° © A^ 
be the even form bundle and = A^ be the odd form bundle. Then both d and 
d* map C°°(M,A^^) into C“(M, The operator 

Dgb =d + d* : C°°(M,A®") C°° [M , A°‘^‘^) 
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is called the Gauss-Bonnet operator. By definition of the (nonnegative) Laplacian, 

D^bDob = A, 

where A is the Laplacian on the even forms. Thus, Dqb represents in some respects 
a square root of the Laplacian. For this reason Dgb is called a Dirac operator after 
the physicist Paul Dirac who in the 1920’s was searching for, and found, a square 
root of the Laplacian in his efforts to quantize the electron. However, in his case, 
he was working with a Lorentz metric rather than a Riemannian metric. 

Before presenting the index formula interpretation of the Gauss-Bonnet for- 
mula, we recall two results from Hodge theory. We denote the Sobolev space of 
order k by So, consists of those even-degree forms u on M such 

that for each 0 < j < k, {d d*yu is square integrable. Then is the 

natural domain of Dqb- 

Theorem 1.2. The operator Dqb • A^^) L^(M, A°^^) is Fredholm, 

which means that it is ‘almost invertible ’ in the sense that 

(1) Dgb has a finite dimensional kernel; dimkev D gb < oo. 

(2) Dgb has a finite dimensional cokernel; 

dim coker Dgb = dim (L^(M, A°^^)/Im(DGB)) < oo. 

The first condition means that Dgb is ‘almost injective’ in the sense that 
it is injective up to a finite dimensional space, and the second condition means 
that Dgb is ‘almost surjective’ in the sense that it is surjective up to a finite 
dimensional space. The index is the difference between the dimensions of the kernel 
and cokernel: 



md Dgb = dimkev Dgb ~ dim coker Dgb ^ 

Theorem 1.2 follows from the fact that Dgb is elliptic, and can be proved in a 
variety of ways, for instance, using pseudodifferential operators [ 34 ], by embedding 
properties of Sobolev spaces [ 74 ], or my favorite proof via the heat operator [ 9 ]. 
The second result we need is: 

Theorem 1.3. The index of Dgb is the Euler characteristic of M , 

indI)GB == X{^)- 

This result can be proved using the Hodge theorem, which is described as 
follows. Define the A;-th deRham cohomology of M by 

= {ae ; da = 0}/{d/3; G A''”')}. 

The Hodge theorem states that given a deRham cohomology class [a] G 
there exists a unique representative of this class (3 G [a] such that {d-\-d*)P — 0. It 
is worthwhile mentioning that although the exterior derivative d is canonical, the 
operator d* depends on the Riemannian metric chosen on the manifold. The work 
of Connes with Gromov and Moscovici [ 25 ] treats a branch of index theory which 
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deals with the analytic difficulties involved in not having a suitable invariant inner 
product. In any case, the Hodge theorem implies the important fact 

ker(d -h d*) on /c forms = 

Now using the description of the Euler characteristic in terms of the cohomology: 
X{M)= ^ dim ^ dim 

k even k odd 

= dimHUM) + dim if|R(M) - 

and the fact that coker Dcb — kerDJ^, one gets Theorem 1.3. In view of the 
Gauss-Bonnet formula (1.1), we finally have 

Theorem 1.4 (Index version of Gauss-Bonnet). For the Gauss-Bonnet op- 
erator on a compact, oriented, two-dimensional Riemannian manifold M without 
boundary, we have 

ind Dgb = ^ 

The profound aspect about this version of the Gauss-Bonnet formula is that 
the left-hand side is a functional analytic object related to the existence and 
uniqueness of solutions to the equation Dqbu = /, while the right-hand side 
is a topological/geometric object. Hence, this formula implies the important fact 
that the topology /geometry of the manifold can be investigated using functional 
analysis. We now discuss a far-reaching generalization of this formula to higher 
dimensional manifolds without boundary. We discuss generalizations of the Gauss- 
Bonnet formula (1.3) for manifolds with corners in Sections 3, 5, and 6. 



2. The Atiyah-Singer index formula 

According to Hirzebruch (cf. [ 14 , p. vii]) the Atiyah-Singer formula is “one of 
the deepest and hardest results in mathematics” , “probably has wider ramifications 
in topology and analysis than any other single result” . Although the proof of the 
Atiyah-Singer formula is difficult, understanding it is not if one keeps in mind that 
it is basically a higher dimensional analog of the Gauss-Bonnet formula. 

In this section, we describe the Atiyah-Singer index formula and we outline 
its proof using the ‘heat kernel method’. 

2.1. Statement of the Atiyah-Singer index theorem. There are two 
ingredients to the Atiyah-Singer index formula. The first is topological/geometric 
data: Let M be an even-dimensional, compact, oriented, Riemannian manifold 
without boundary, and let E and F be Hermitian vector bundles over M. The 
second ingredient is functional analytic /geometric data: Let 

D : C^{M,E) -> C^{M,F) 
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be a Dirac type operator. This means that D is an elliptic first-order differential 
operator such that = A” in the sense that the principal symbol of D*D is 

just the metric a{D*D){^) = for all cotangent vectors 

The simplest example of a Dirac type operator is the Cauchy-Riemann oper- 
ator. Let M = with its usual Euclidean metric and let E = F = C. Then 

Dcr = + idy 

is the Cauchy-Riemann operator. In this case, 

DchDcr ={-d^j, + idy) [d^ + idy) =-[dl+ dl) 

is exactly the Laplacian. 

Another example is the higher-dimensional Gauss-Bonnet operator. Let M be 
an even-dimensional, compact, oriented, Riemannian manifold without boundary, 
and let E and F be the even and odd degree form bundles, respectively: 

E = A®^=0A'' and F = = 0 A^ 

k even k odd 

Then, 

Dob = d + d* : 

is called the Gauss-Bonnet operator. By definition of the Laplacian on forms, we 
have DqqDgb = and so Dgb is a Dirac operator. Since the even and odd form 
bundles are real bundles, they of course are technically not Hermitian, but we can 
always make them so by complexifying them. Regardless, the index formula below 
still applies to the Gauss-Bonnet operator. 

The celebrated Atiyah-Singer index theorem is the following. 

Theorem 2.1 (Atiyah-Singer, 1963). Let D : C^{M,E) he 

a Dirac type operator on an even- dimensional, compact, oriented, Riemannian 
manifold without boundary. Then, D : H^{M,E) LP‘{M,F) is Fredholm and 

(2.1) indD= [ Kas, 

J M 

where the ^Atiyah-Singer integrand’ Kas explicitly defined polynomial in the 

curvature forms of the manifold M and the vector bundles E and F. 

The integral of the polynomial Kas is by definition the integral of the volume 
form component of Kas- For those readers familiar with characteristic classes, the 
polynomial Kas is the product of the A polynomial of M and the (relative) Chern 
polynomials of E and F, see [9, Ch. 4]. Hence, Kas is both a topological and a 
geometric object. The reason why we assume that M is even-dimensional is that 
for odd-dimensional manifolds it turns out that both sides of (2.1) are zero. 

Note the similarity between the index version of the Gauss-Bonnet formula 
given in Theorem 1.4 and the Atiyah-Singer formula for the index of a Dirac type 

^In some occasions, we will need D to be a compatible Dirac operator, which means that 
it is associated to a ‘unitary Clifford connection’. For simplicity, we leave this notion undefined, 
and at the few places where we actually need this extra hypothesis, we will state so in a footnote. 




INDEX OF DIRAC OPERATORS 



137 



operator: The Gaussian curvature in the Gauss-Bonnet formula is replaced by 
a polynomial in the curvature of the manifold and vector bundles. As with the 
Gauss-Bonnet formula, the profound feature of the Atiyah-Singer formula is that 
the left-hand side of (2.1) is a functional analytic object related to the existence 
and uniqueness of solutions to the equation Du — /, while the right-hand side is 
a topological/geometric object. In particular, the Atiyah-Singer formula has the 
following deep consequence: It implies that the topology /geometry of a manifold 
can be investigated using functional analytic tools, cf. [ 72 ], [ 55 ], and Section 2.3. 

For an application of the Atiyah-Singer index theorem, consider the Gauss- 
Bonnet operator defined above. As in the two-dimensional case explained before 
Theorem 1.4, for a general even-dimensional, compact, oriented, Riemannian man- 
ifold without boundary, Hodge theory implies that 

ind Dgb = x(^)- 

On the other hand, see [ 9 , Ch. 4] for the details, working out the explicitly defined 
polynomial Kas for E = A^^ and F — gives, after a little bit of algebra, 

KAs = e{M), 

where e(M) is the Euler, or Pfaffian, polynomial defined by taking the n-th power 
of the Riemannian curvature tensor of M and multiplying it by l/n\ x (— 1/27 t)^, 
where 2n is the dimension of M. Thus, the Atiyah-Singer index formula implies 

X(M) = / e(M). 

J M 

This generalization of the Gauss-Bonnet formula is due to Chern [ 23 ]. 

Another important corollary of the Atiyah-Singer formula is Hirzebruch’s for- 
mula for the signature of a manifold. Assume now that M is Ak dimensional. Then 
the map 

3 ([«],[/?]) ^ / aA/3€K 

J M 

is a well-defined symmetric bilinear map (here, [ • ] denotes the corresponding co- 
homology class). We can represent this map by a matrix by choosing any basis 
of the finite dimensional real vector space i7j^(M). The signature of this matrix, 
the number of positive eigenvalues minus the number of negative ones, is defined 
independent of the basis chosen; the signature of the manifold, sign(M), is by def- 
inition the signature of the matrix with respect to any such basis. Hirzebruch [ 42 ] 
gives a formula for the signature: 

sign(M) = j C{M), 

where C{M) is the £-class polynomial in the curvature tensor of M. This formula 
is a simple corollary of the Atiyah-Singer index theorem. In this case, D is the 
‘signature operator’, which is equal to d-\- d* like the Gauss-Bonnet operator, but 
with the vector bundles E and F being essentially certain eigenspaces of the Hodge 
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star operator. The details can be found in [9]. For those interested readers, the 
£-class polynomial is given by 

^ (tanh(il/2^’ 

where R is the Riemannian curvature tensor. 

Yet another classical formula that is a simple corollary of the Atiyah-Singer 
index formula is the Riemann-Roch formula and its generalization to complex 
manifolds, see [9], [34], [74]. 

2.2. Outline of the proof of the Atiyah-Singer formula. We outline 
a proof of the Atiyah-Singer index theorem based on the heat kernel approach 
of Mckean and Singer [57] as exploited by Atiyah, Bott, and Patodi in [2]. For 
accessible versions of the proof, see [9], [34], [82]. I especially like the exposition 
by Roe [74]. 

To start off, we need the heat operators ^ and . Consider for 

instance ^ . Then, for each t > 0, 

and it is the solution operator to the heat equation for D^D in the sense that for 
each u G C°°(M, E), Ut = is the unique solution to the heat equation 

{dt + D*D)ut =0, t > 0; uq = u. 

The heat operator can be defined by means of the resolvent and the func- 

tional calculus (cf. [34], [51]), it can be constructed asymptotically via Hadamard’s 
method (cf. [9], [59]), or it can be defined using the spectrum as follows. Let {Xj} 
be the eigenvalues of the self-adjoint operator Then, 

e-^D^D 

3 

where tt^ is the orthogonal projection onto the eigenspace associated to the eigen- 
value Xj. This sum converges uniformly and absolutely and in fact, it can be used 
to show that the heat operator is, for each t > 0, a smoothing operator; that is, 
for each t > 0 the heat operator is an integral operator with a smooth Schwartz 
kernel [74]. In particular, for each t > 0, the heat operator is trace class and 

(2.2) ^ = 7TkerD*D + ^(^)^ 

where the remainder F{t) — > 0 exponentially in the space of smoothing operators 
as t 00 . A similar formula holds for . 

The key steps of the Mckean- Singer proof are to consider the function 

h{t) - Tr(e“*^*^) - Tr(e-^^^*) 
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and to prove the following amazing properties: 

(1) lim h{t) = indD, 

>CXD 

(2) lim h(t) = f Kas, 

(3) = 0 so that h{t) is constant. 

Equating the values of the constant function h{t) at ^ = 0 and t = oo proves the 
index formula. Consider property (1). The formula (2.2) implies that 

lim h{t) = Tr(7TkerD*D) - Tr(7TkerDD0 

t— ^oo 

= dimker — dimker T)D*. 

Integration by parts shows that kerD*D = kerD and kevDD* = kerD*. Indeed, 
clearly kerD C kerD*D and if (•, •) denotes the inner product, then 

D*Du = 0 => {D*Du,u) = 0 ^ (Du,Du) = 0 Du = 0. 

Thus kerD*D C kerD and so kerD*D = kerD. Similarly, kerDD* = kerD*. 
Thus, as coker D = ker D* , we obtain 

lim h{t) = ind D. 

t^oo 

To determine the limit as t 0 of h(t), we use the trace formulas: 

Tr(g-tD*D) ^ f Tr(e“^^^*) = f tr (p,p) 

J M J M 

obtained by integrating the pointwise trace of the heat kernels restricted to the 
diagonal. Now the local index theorem states that^ 

lim{tre“^^ ^(p,p) - tr (p,p)} = Kas{p) 

uniformly in t, where the right-hand side really represents the coefficient of the 
volume form component of the differential form Kas{v)- This result was proved 
originally by Mckean and Singer [ 57 ] for dimension two, generalized to higher 
dimensions by Gilkey [ 32 ] using invariance theory, and by Patodi [ 70 ] using a 
super- symmetry trick which was further developed by Alvarez-Gaume [1] in the 
setting of path integrals and by Getzler [ 30 ] in a pseudodifferential setting. Thus, 



lim/i(t)= / Kas- 



Hence, by the fundamental theorem of calculus, we have 

/> noo ^ 

(2.4) indZ?- / A'as = / -^h{t)dt. 



^This formula technically only applies to compatible Dirac operators, and not to arbitrary 
Dirac type operators. In general, the left-hand side of (2.3) has an asymptotic expansion els t ^ 0 
starting with negative powers of t and the right-hand side is the constant term in the expansion. 
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We now show that ^h{t) = 0. We first claim that D*De — D*e D. 

To see this, let u G C^{M,E). Then, vt — D"" De~^^* and Wt — Du 

agree at t = 0 and they both satisfy the equation {dt + D*D)ut = 0. By uniqueness 
of solutions to the heat equation [59, p. 271], we must have Vt — Wt, hence, 

Thus 

^h{t) = Tr ( - D*De~*^'° + DD*e~*^‘^') 

at ^ 

(2.5) =Tr{ - D + DD*e-*^^') 

= Tr([D,£)*e-‘^^*]), 

where [D, ] is the commutator of D and . Using the well-known 

fact that the trace vanishes on commutators of pseudodifferential operators when 
at least one factor is smoothing implies that ^h{t) = 0. Hence, according to (2.4) 
we have 




which is the Atiyah-Singer formula! 

2.3. Some remarks on the Atiyah-Singer index theorem. The Atiyah- 
Singer index formula can be generalized to elliptic pseudodifferential operators 
using K-theory. However, in this generality, the form Kas occurring on the right- 
hand side of the index formula is not explicitly defined in terms of the curvature 
forms. The fact that Kas is explicitly defined in terms of the curvature forms for 
Dirac type operators is a very special property of Dirac operators and is one of the 
reasons why Dirac operators are important in applications. The original proof of 
the Atiyah-Singer index theorem as sketched in [6] used cobordism theory, cf. [69] . 
A few years later, the proof was reworked in a series of papers [7, 8]. The ‘heat 
kernel proof’ appeared in [2]. See [14] for a comparison of the various proofs. 
The Atiyah-Singer formula has been generalized to many different contexts, for 
example, to families of Dirac operators by Bismut [11], see [74], [9], and especially 
[34, Ch. 5] for other generalizations. 

The Atiyah-Singer index theorem has far-reaching applications (see [45, Ch. 4]) 
that include group actions on manifolds, immersions into Euclidean space, inte- 
grality and divisibility of certain characteristic numbers, existence of metrics with 
positive scalar curvature [37], twisted signature and Riemann-Roch-Hirzebruch 
formulas, and formal dimensions of certain moduli spaces [27, 36]. 

3. The At iyah- Pat odi- Singer index formula 

Now we cisk a similar question concerning the Atiyah-Singer index formula 
as we did for the Gauss-Bonnet formula in the introduction: Does the Atiyah- 
Singer formula, indD = J^^Kas^ continue to hold verbatim if M has a smooth 
boundary? From our experience with the Gauss-Bonnet formula, we expect that 
the answer is “no” ; there should be a correction term added to the right-hand side 
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Figure 2. The manifold M with a collar neighborhood near its 
boundary over which all geometric structures are of product type. 

due to the presence of the boundary. This is in fact the case. It turns out that the 
correction term is a spectral invariant of the boundary. 

In this section, we describe the Atiyah-Patodi-Singer (or APS) index formula 
[5], which extends the Atiyah-Singer formula to manifolds with boundary. For 
manifolds with boundary, there are various ways to develop an index theory, for 
instance, introducing boundary conditions or ‘attaching a cylindrical end’ to the 
boundary. We focus on the latter method. For the BVP point of view, see [15]. Fi- 
nally, we reformulate the index problem in terms of Melrose’s 6-geometric objects. 

3.1. Attaching a cylindrical end. The ingredients of the APS index for- 
mula include topological/geometric data: Let M be an even-dimensional, compact, 
oriented, Riemannian manifold with boundary and let E and F be Hermit ian vec- 
tor bundles over M. For simplicity, we assume that M has a collar neighborhood 
M = [0, l)s X Y where the metric is a product g = + h with h a metric on 

Y = dM, and where E and F are isomorphic to their restrictions Eq and Fq 
respectively to Y over this collar. See Figure 2. 

We are also given functional analytic/geometric data: Let 

D : C^{M,E) C^{M,F) 

be a Dirac type operator, a first-order elliptic differential operator such that the 
principal symbol of VD is the metric a{D* D){^) = |^|^ for all cotangent vectors 
We assume that D is of product type on the collar of the following sort: 

D = r{ds + Dy), 

where 

Dy:C^{Y,Eo)^C^{Y,Eo) 

is a self-adjoint Dirac type operator on the odd-dimensional manifold T, and where 
r is a unitary isomorphism from Eq onto Fq. With these hypotheses, one might 
think that D : H^{M, E) F) is Fredholm. This however is not the case. 

Theorem 3.1. The Dirac type operator 

D : H^{M,E) -> L^{M,F) 

is never Fredholm. In fact, its kernel is infinite dimensional! 
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Figure 3. Attaching an infinite cylinder to M produces the man- 
ifold with cylindrical end M. 

A proof of Theorem 3.1 can be found in [15]. To see why this theorem holds, 
consider the following simple example. Let Mq = [0, 1] x with metric g — 
ds^ + d6‘^, lei E — F — C, and let 

D^^ds-i- ide. 

Certainly, the manifold and operator are of product type. Moreover, ker T>o consists 
of all functions /(s, 0) that are holomorphic in 2 ; = for 0 < s < 1 and periodic 
in 0 with period 27 t. Of course, there are infinitely many such functions, for example 

where /c G Z. Thus, dim ker Do = 00 . 

Since D is not Fredholm, it might look like our hopes for an index formula 
are crushed. By the way, it turns out that in general, D : L‘^{M^F) 

is surjective [15]. Thus, the problem with D is its kernel on H^{M, E). There are 
various ways that have been developed to ‘tame’ the infinite dimensional kernel. 
One successful method is the theory of boundary value problems pioneered by 
Calderon [19] and Seeley [77] as explained in [15]. However, we will focus on the 
method of attaching a cylindrical end, which is described as follows. 

Consider Dq = dg -\-ido on the enlarged manifold Mq = (— 00 , oo)s x rather 
than on Mq — [0, l]s xSL Here, Mq has the naturally extended metric g == ds‘^-{-d0‘^. 
We claim that on Mq, we have kerDo == 0 on H^{Mq). Indeed, kerDo consists of 
all functions f{s,0) G H^{Mq) that are holomorphic in 2: = s + for s G IR and 
periodic in 0 with period 27 t. By Sobolev embedding, f is bounded in s and hence 
is a bounded holomorphic function on C, so is constant by Liouville’s theorem. 
Since / G H^{Mq), the constant must be zero. 

With this example as motivation, in the general case we enlarge the compact 
manifold with boundary M to a noncompact manifold M as follows: Let M be the 
manifold formed by taking the infinite cylinder (— oo,0]s x Y and gluing it onto 
the end of the collar [0, l)s x T of M as shown in Figure 3: 

M — (— 00 , 0]s X Y UdM Af. 

Since all the geometric structures and the Dirac operator were of product type on 
the collar of M, they all have natural extensions to the manifold M. We denote 
these extended structures on M using the same notations for the original objects on 
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M; however, since the extended Dirac operator on M has a completely different 
domain than the Dirac operator on M, we denote the extension of the Dirac 
operator by D. Note that the natural domain of D is which consists 

of those sections u on M such that Du is square integrable with respect to the 
measure dg on M. Now we ask: Does this idea work? Is the operator D Fredholm 
on its natural domain? The answer is: sometimes. It turns out that the boundary 
operator Dy, which can be considered the model operator for D ‘at infinity’ on 
the cylindrical end, determines the Fredholm condition. 

Theorem 3.2. The Dirac type operator 

D : H\M,E) L^{M,F) 

is Predholm if and only if the boundary operator Dy '■ H^{Y,Eq) — » L‘^{Y,Eq) is 
invertible; that is, if it has zero kernel. 

It turns out that the kernel of D is always finite dimensional, so the enlarge- 
ment of M to M did tame the infinite dimensional kernel of D as expected, but the 
cokernel of D is infinite dimensional unless Dy is invertible. For a proof of Theo- 
rem 3.2, see [ 59 , Th. 5.60]. There is a general principle underlying the Fredholm 
properties of Dirac operators on noncompact manifolds: 

General Principle: A Dirac operator on a noncompact 

(3.1) 

^ manifold is Fredholm if and only if it is invertible ‘at infinity’. 

Recall that a Fredholm operator is an operator that is ‘almost invertible’. Roughly 
speaking, a Dirac operator is always ‘almost invertible’ on the ‘compact end’ of a 
noncompact manifold simply because a Dirac operator is elliptic so we can always 
construct a parametrix for it on the compact end; however, to construct a global 
parametrix for the Dirac operator, we need to invert the Dirac operator ‘at infinity’. 

We now show that Dirac operators can always be made Fredholm on weighted 
Sobolev spaces. To see this, extend the coordinate function s on the cylindrical 
end of M into the compact end of M to be a positive function there. Let o G M. 
Then observe that on the cylindrical end we have 

e~^We^^ =r{ds + Dy + a), 

and Dy -h o is invertible for |a| > 0 less than the smallest absolute value of a 
nonzero eigenvalue of Dy. Hence, the ‘General Principle’ implies that 

e““"5e“® : H\M,E) L^{M,F) 

is Fredholm for all |a| > 0 sufficiently small, which is equivalent to 

D : e°‘^W{M,E) e°^L‘^(M,F) 

is Predholm on weighted Sobolev spaces. Thus we have the following; 
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Theorem 3.3. There exists a J > 0 such that for all 0 < \a\ < S, the Dirac 
type operator 

D : E) ^ e“U2(M, F) 



is Fredholm. 

For the proof of this theorem, see [59, Th. 5.60]. We next state the APS 
formula for the index of the operator D on weighted Sobolev spaces. 



3.2. Statement of the Atiyah-Patodi-Singer index theorem. Before 
stating the APS index theorem for the operator _D, we first need to define the 
eta invariant. Since Dy is a self-adjoint elliptic operator on the closed compact 
manifold T, it has discrete spectrum {Aj} C M. The eta function, r]{z), is the 
holomorphic function 






sign \j 



One of the main results of [5] was that rj{z) defines a meromorphic function on C 
that is regular at 2 : = 0. The eta invariant of Dy is the value of the eta function 
at zero, rj{Dy) = 77 ( 0 ), which represents a formal signature of the operator Dy: 



'‘ti{Dy) = ^ sign A, = #{A, > 0} - #{A^ < 0}”. 

Xj 7^0 



Thus, rj{Dy) is a measurement of the spectral asymmetry of Dy. Another way to 
express the eta function is through the heat operator: 

(3.2) T]{z) = / t^Tr{DYe-^°y)dt, 

i V 2 A •'O 

where P( 2 ;) is the Gamma function. This formula follows from the fact that 



Tr{DYe~*^y) = Aj 



and that 



r(^) 



/ 



Z-l ^ 

t 2 Xj e 



txi 



dt ■ 






where we made the change of variables t Moreover, the local index 

theorem for odd- dimensional manifolds proved by Bismut and Freed [10] states 
that Tr{Dye~^^^) is a smooth function of vanishing at t = 0, and so the 
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formula (3.2) can be used to prove that^ 

(3.3) r/(£>y) = ^ / 

V ^ Jo 

We are now ready to state the At iyah-Patodi- Singer index theorem. 

Theorem 3.4 (Atiyah-Patodi-Singer, 1973). Let D he a Dirac type operator 
on an even- dimensional, compact, oriented, Riemannian manifold with boundary 
with product type structures specified. Then there exists a ^ > 0 such that for all 
0 < |a| < S, the Dirac type operator 

D : e^^W{M,E) e°“‘L^{M,F) 

is Fredholm and if its index is denoted by inda D, then 

mda£> = j - i|r?(Z?y) + signa • dimkerDyj, 

where Kas the Atiyah-Singer integrand and t]{Dy) is the eta invariant. 

The APS theorem in [5] technically only applies to the case of a > 0; as 
presented above, the theorem is due to Melrose [59]. We prove this theorem using 
Melrose’s 6-geometry approach in Section 4. An important corollary is the notable 
generalization of Hirzebruch’s signature formula to manifolds with boundary: If D 
is the signature operator, then using the fact that ind^ D + ind_a D = 2sign(M) 
for (T > 0 sufficiently small (see [59, Sec. 9.3]) gives 

2sign(M) — J C{M) — ^|ry(Dy) +dimkerT)y| 

+ f £(M) - ^|?7(i:)y) - dimkerDy|, 
or 

sign(M) = f C{M) - \v{Dy)- 

Jm ^ 

Hirzebruch’s conjecture for the signature-defect, the difference between the signa- 
ture of M and the integral of the /2-class polynomial, was the original motivation 
of Atiyah, Patodi, and Singer in the discovery of the eta invariant [4, 5]. 



"^Actually, the local index theorem for odd-dimensional manifolds is not true for arbitrary 
Dy but only for those associated to a ‘unitary Clifford connection’, cf. the discussion in footnote 
(3) concerning the local index theorem for even-dimensional manifolds. In general, Tr(Dy ) 

only has an asymptotic expansion as t 0 starting from negative powers of t. In this case, the 
lower limit 0 in the integral (3.3) must be replaced by e > 0 and the resulting integral has 
an asymptotic expansion as e ^ 0. The right-hand side of the above equation represents the 
constant term in the expansion. 
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Figure 4. The compact manifold with boundary X is the com- 
pact ificat ion of the manifold with cylindrical end M. 



3.3. Interpretation as b-objects. One of the primary tools used to prove 
Fredholm properties of Dirac operators, or elliptic differential operators in general, 
on compact manifolds without boundary is the algebra of pseudodifferential opera- 
tors. Such an algebra would be useful on a manifold with cylindrical end in order to 
prove Fredholm properties of Dirac operators on such manifolds. For various classes 
of operators defined on noncompact manifolds, see Lockhart and McOwen [49], 
Rabinovic [73], or Schrohe [76]. One usually requires the noncompact manifold to 
have a finite atlas with control at infinity of the coordinate changes and special 
estimates at infinity on the symbols of the operators considered on the manifold. 
In particular, a direct definition of pseudodifferential operators on manifolds with 
a cylindrical end might be considered unbalanced as the analysis is treated in 
distinctly differently ways on the cylindrical end and the compact end. 

Melrose’s novel idea was to unify the analysis on these two ends by making 
the whole manifold compact; that is, compactifying the cylindrical end forming a 
compact manifold with boundary. On this new compact manifold with boundary, 
he defines a space of pseudodifferential operators, imitating as close as possible, 
the global geometric definition of pseudodifferential operators on compact man- 
ifolds without boundary in terms of their Schwartz kernels as discussed in, for 
example, Hormander [43]. The resulting operators are called 6-pseudodifferential 
operators. For excellent introductions to this subject, see Grieser [35], Mazzeo [56], 
or Melrose [59]. 

We now explain the compact ificat ion. On the cylindrical end (— oo,0]s x T of 
M we make the change of variables x = e^. Ass — oo,x 0. Thus, under 
this change of variables, M becomes the interior of the compact manifold with 
boundary A, where X has the same compact end as M but with the cylindrical 
end (— oo,0]s x Y replaced with the compact manifold [0, l]^ x F, see Figure 4. 
Since x = e^, we have ds = dx/x and dg = xdx> Thus the geometric objects on 
the manifold with cylindrical end transform into corresponding singular geometric 
‘6-objects’ on the compact manifold with boundary: 



g — ds^ + h g = — j + h (6-metric), 

dx 

dg = dsdh ^ dg = — dh (6- measure). 



X 
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and consequently, 

H^(M) ^ H^{X) (6-Sobolev space), 

D = T{ds Dy) ^ D = T{xdx + ^y) (^-differential operator). 

Although the manifold X is topologically compact, its interior is geometrically a 
manifold with cylindrical end since X inherited all its geometric structures from 
M. In particular, the boundary of X is geometrically at infinity. The fact that 
X is compact is key to the definition of 6-pseudodifferential operators since these 
operators are defined using only the usual classes of smooth functions and dis- 
tributions on compact manifolds with boundary. Of course, there is a trade off: 
The distributions defining the Schwartz kernels of 6-pseudodifferential operators 
are required to have a special structure, which takes some time getting used to 
[59, Ch. 4]. 

We repeat the statement of the APS index theorem in the current context. 

Theorem 3.5. With the same hypotheses as in Theorem 3.4, hut now in the 
b-geometry context, there exists a 5 > 0 such that for all 0 < \a\ < S, the Dirac 
type operator 

D:x»Hl{X,E)-^x‘^Ll{X,F) 

is Fredholm and if its index is denoted by indc^ D, then 

mdc,D = j ii'As - + signa • dimkeri?v'|, 

where Kas the Atiyah-Singer integrand and rj(Dy) is the eta invariant 

1 

t]{Dy) = -j= 

Jo 

In Section 4, we prove this theorem. 

3.4. Some remarks on the Atiyah-Patodi-Singer index theorem. The 

original Atiyah-Patodi-Singer index theorem was proved in the context of (pseudo- 
differential) boundary value problems. A nice introduction to these methods can be 
found in the book by Boofi-Bavnbek and Wojciechowski [15]. The ‘direct approach’ 
to the APS boundary value problem based on asymptotic expansions of the heat 
operator was initiated by Grubb and Seeley [39], see also Grubb’s book [38], The 
approach of ‘attaching cylinders’ was mentioned in [5], but was not developed. 
Besides attaching a cylinder to the boundary, another way to develop an index 
theory on manifolds with boundary is by attaching a cone, see Cheeger [22]; for 
other generalizations, see Atiyah, Donnelly, and Singer [3], Muller [64], Stern [81], 
Brlining [16], Fedosov and Schulze [29], Schulze, Sternin, and Shatalov [79], and 
Carron [21]. Melrose introduced the 6-geometry in the seminal paper [58], and 
these ideas were developed by Melrose and Mendoza in [60]. The APS index for- 
mula was generalized to Fredholm 6-pseudodifferential operators by Piazza [71]. 

The eta invariant itself has become a topic of much interest. In particular, the 
extension of the eta function and its regularity properties for pseudodifferential 
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operators has been examined by Gilkey [33] and Wodzicki [85] among others. For 
a survey of various topics on the eta invariant, including its decomposition under 
gluing of manifolds, see Mazzeo and Piazza [55]. 

The index theorem for families of Dirac operators was extended to the case 
when the fibers are manifolds with boundary by Bismut and Cheeger [12, 13] un- 
der the assumption that the Dirac operators on the fibers of the boundary fibration 
are invertible. Later, this result was generalized by Melrose and Piazza [62, 63] 
with no assumptions on the boundary Dirac operators. For further extensions of 
the index formula, see Getzler [31], Wu [86], Melrose and Nistor [61], and Leicht- 
nam, Lott, and Piazza [46]. 

Other expository articles incorporating recent developments on the APS in- 
dex theorem include Muller [66], Piazza [72], and Seeley [78]. Because of space 
constraints, we have only touched the surface on some of the many extensions and 
generalizations of the Atiyah-Patodi-Singer problem, a list of references can be 
found in the book by Gilkey [34, Ch. 5]. 



4. Melrose’s b-geometry proof of the Atiyah-Patodi-Singer theorem 

Let D be a Dirac type operator on an even-dimensional, compact, oriented, 
Riemannian manifold with boundary M with product type structures near the 
boundary as described in Section 3.1. For simplicity, we assume that the boundary 
Dirac operator Dy is invertible. Now form the manifold with cylindrical end M 
and then compactify it under the change of variables x = , where s is the variable 

on the cylinder, to form the manifold X as described in Section 3.3. Then D defines 
an operator on X such that 

D:Hl{X,E)^Ll{X,F) 

is Fredholm. We now give the 6-geometry proof of the APS index formula in 
Theorem 3.5 modeling, as close as possible, the proof the Atiyah-Singer formula 
given in Section 2.2. We shall see that there are certain variations to the proof 
that need to be fleshed out in order to make the proof work. 

4.1. The proof of APS with details left out. As with the Atiyah-Singer 
proof given in Section 2.2, we would like to define the Mckean-Singer function 

Here, we meet our first variation to the Atiyah-Singer proof - the reason for the 
quotation marks is that the heat operators are not trace class, and so the traces are 
not even defined! Basically, the heat operators are not trace class because X has 
infinite volume (is geometrically not compact) which implies that the heat kernels 
restricted to the diagonal are not integrable. Thus, we cannot prove the APS 
formula by imitating the proof of the Atiyah-Singer formula verbatim. However, 
in Section 4.3, we define a natural extension of the trace called the 6-trace, denoted 
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by ^Tr, such that the heat operators are 6-trace class. We can now define a modified 
Mckean-Singer function 

h{t) = ^Tr(e-'^*^) - ^Tr(e-'^^*), 



and continue as in Section 2.2. As in the manifold without boundary case, the 
following limits hold: 

lim h{t) — indD, 

t^oo 



and^ 




Kas- 



In fact, using 6- pseudodifferential operators, the proofs of these two results are not 
much different from the corresponding proofs in the manifold without boundary 
case, see Chapters 7 and 8 of [59] for the proofs. Continuing as in Section 2.2, we 
find that 

mdD= / Kas+ / —h{t)dt, 

JM JO 

where repeating the same algebraic calculation as before, we have 



Here, we meet our second variation - in the proof of the At iyah- Singer index for- 
mula, this expression is zero, in this present case it is not. Figuratively speaking, 
the 6-trace is a trace on the interior of X and only fails to be a trace on the bound- 
ary of X. Thus intuitively, ^Tr ([!), should be a boundary integral of 

some sort. This is in fact the case; in Section 4.4 we compute that 



^Tr ]) = = Tr(Dy Tv{Dy 

VAirt 2V7t 

Hence, 

indD = j Kas ~ yiiDy), 

where 

rtiDy) = TtiDy e~^^y)dt, 

V'^ JO 

and the At iyah-Patodi- Singer index formula is proved! 



^The same discussion as in footnote (3) concerning the local index theorem on manifolds 
without boundary applies in this situation too. The integral of Kas is over M because the 
product type assumption implies that the volume form component of Kas is supported on the 
manifold M regarded as a subset of X. 
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4.2. Some facts about the heat kernels. To implement the proof in Sec- 
tion 2 . 2 , we need the heat operators 

: LliX, E) ^ Hl{X, E) and : Ll{X, F) ^ H^{X, F). 

It turns out that these heat operators are 6 -smoothing operators; that is, they are 
6 -pseudodifferential operators of order — oo [59, Ch. 7], which implies a couple of 
useful results. These results can be proved using other methods, but the theory of 
6 -pseudodifferential operators gives these results more or less Tor free’. First, the 
Schwartz kernels of these heat operators are smooth on the interior of vanishing 
to infinite order at dX‘^ except at dX x dX. The second result is that these heat 
operators have a simple structure on the collar of X described as follows. For 
concreteness, we focus on . On the collar [0, l]x xY of X we have 

D = T{xdx + Dy), 

where F is a unitary isomorphism of Eq onto Fq. Thus, on the collar, 

DD* = r(xd^ + Dy){-xd^ + Dy)T* = r{{xD:of + £>y)r*, 
where Dx = i~^dx^ This suggests that near dX we have 

where is the heat operator for xDx on [ 0 , oo)^;, and where 0{x) is an 

operator smooth in x and vanishing at a: = 0. In fact, even a stronger result is true. 
Under the change of variables s = logx, which takes the interior of [0, oo)^; onto 
(— 00 , 00 ) 5 , we have xDx = Dg. Since the Schwartz kernel of on (— 00 , 00)5 

is given by the well-known formula 

y/Airt 

the Schwartz kernel of is obtained by setting s — logx: 

Ki(x,x',t) = 

The second result is that the Schwartz kernel of near dX x dX is given by 

(4.1) e~*’^’^\x,y,x',y') = T{y)Ki{x,x' ,t) e~^^^{y,y')T{y')* + 0{x), 

where 0{x) is a smooth function of the variables x, logx — logx', y, and y' that 
vanishes at x = 0 . 

4.3. Filling in the details for the b-trace. The simple fact that dx/x 

is not integrable over [ 0 , l]x implies that the heat operators are not trace class. 
Indeed, consider the heat operator . By (4.1), on the collar [0, l]a; xY we 

have 

(4.2) {x,y,x,y) = (y, y) + C?(a;), 

V47r^ 
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where we used that TT* = Id since F is a unitary isomorphism, and where 0{x) 
is smooth in x and vanishes at x = 0. Since dg = (dx/x) dh on this collar and 

J ti y) ^dh= ■ j (y,y) dh, 

[0,l]xv 

the following trace formula does not make sense: 

Tr(e-^^^*)= [ tve-^^^\p,p)dg. 

Jx 

Similarly, the corresponding integral for ^ does not exist. Although the trace 
formula above does not make sense, we can ‘force’ it to make sense by the con- 
sidering another notion of trace and integral as we now describe. Note that for 
Rez > 0, x^ is integrable with respect to dx/x over [0, l]x- Extend the coordinate 
function x on the collar of X to be a smooth function on X which is positive off 
the collar. Then it follows that is trace class for Rez > 0 with trace 

given by 

)= [ x^tT (p, p) dg, Re ^ > 0. 

Jx 

This argument is the basis for defining a new functional called the 6-trace, which 
we introduce after the following lemma. 



Lemma 4.1. Let f G C^{X). Then for all complex numbers z with Rez > 0, 
the integral 

F{z) = [ x^fdg 

Jx 

exists, and it extends from Ke z > 0 to define a meromorphic function on all ofC. 
The h-integral of f is by definition the regular value of F{z) at z = 0.* 

(4.3) f fdg = Reg,^oF(^)- 

Jx 



Finally, the residue of F{z) at z 0 given by 

ReS;j=o F{z) = j /(O, y) dh. 



To understand why this lemma is true, note that x^ = is an entire 

function of z for x > 0. Thus, we may assume that / is supported on the collar 
[0, l]x xY of X. Then F{z) is well defined for Re z > 0 since x^ f(x, y) is integrable 
with respect to the measure {dx/x) dh as long as Rez > 0. Now expand f{x,y) in 
Taylor series at x = 0: f{x,y) ~ Sk{y)’ Since 

/ At X 

[0,l]xV 
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it follows that F{z) extends from Re 2 : > 0 to be a meromorphic function on C 
with only simple poles at 2 : = {0, —1, —2, . . .} with residue at 2 : = 0 given by 

j fo{y) ^ 

To see why the notion of the ^-integral is natural, note that if /(O, y) = 0, 
then F{z) is regular at 2 ; = 0, and 

fdg = Reg,^onz) = F{0)= [ fdg, 

Jx Jx 

which is the usual integral of /. 

The b-trace of the heat operator is by definition 

^Tr(e"^^^*) == {p,p)dg, 

Jx 

where the 6-integral of the function tre“*^^ (p,p) is defined by (4.3): 

d (p,p)dg = Reg,=o Tr{x^e-*^^'). 

Jx 

The 6-trace of ^ is defined similarly. 



4.4. Filling in the details for the eta invariant. In this section, we show 



that 






^Tr([D,D*e-^^^ ]) = — = Tr(Dy e“ 

V 47rt 

The proof is just a computation using the definition of the 6-trace, 

''Tr {[D, D*e-*^^']) = Reg.^o Tr x^[D, 

where Tr x^[D, is meromorphically extended from Rez > 0. Observe 

that 

Since the trace vanishes on commutators, we have Tr[D,x^D*e~*'^^ ] = 0 for 
Rez > 0, and thus its meromorphic extension to all of C is also zero. Hence, 



Tr {[D, = Reg,=o Tr[a;^ D]D 



* —tDD* 



Reg^=oTra;^a(z), 



where 

aiz)=x-^[x\D]D*e-*^^‘ = - x~^ Dx^D*e~^^^\ 

Note that a(0) = 0. We claim that a{z) is an entire function of 2 ;. Indeed, since 
is an entire function of 2 : for a: > 0, we may consider a{z) on the collar [0, l]a: x Y 
over which D = T{xdx + -Dy)- In this case, x~^Dx^ = T{xdx + Dy + z) which is 
entire, so a{z) is entire. Since a{z) is entire and vanishes at 2 ; = 0, we can write 

a{z)^zA + 0{z^), 
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where A is independent of 2 :. It follows that 

= Reg^^o Tr a(z) = Res,=oTrx^ A, 

and so by Lemma 4.1, 

(4.4) ^Tr = J tr A{x,y,x,y)\:c^o dh. 

To calculate this integral, we work over the collar [0, l]x x Y. Here, 
x~^Dx^ — r{xdx + Dy z) = D zT, 

and thus 

a{z) - 33^ -x-^3x^3^e~*^^* = -zV3^e-^^^\ 
which implies that over the collar, 

A = -V3^e-^^^\ 

As D* = {—xdx + Dv)r* and F*r = Id, by (4.1) we have 

yj Ant 

modulo a term that vanishes on the boundary. It follows that 

A{x,y,x,y%=o = — ^ r(y)Dye“*^^ (y, y) r(y)*, 

YAnt 

which in view of (4.4) gives 

J u Dre-‘°'H»,y)dh 

5. Index theory on manifolds with corners of codimension two 

In this section, we describe an extension of the APS index formula to manifolds 
with corners of codimension two. As we discussed for manifolds with boundary, 
there were various ways to develop an index theory for Dirac operators, e.g., in- 
troducing boundary conditions or attaching a ‘cylindrical end’ to the boundary. 
For manifolds with corners, it turns out that there is no well-developed theory of 
boundary value problems for Dirac operators. However, we can still formulate an 
index problem by attaching ‘multi-cylindrical ends’ and considering an L^-index 
problem. 
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Figure 5. Examples of manifolds with corners of codimension 
one, two, and three respectively. 



5.1. Dirac operators on manifolds with corners. We begin by defining 
manifolds with corners. An n-dimensional manifold with corners X is a paracom- 
pact Hausdorff topological space with local charts of the form [0, 1)^ x (—1, 1)^“^, 
where k can run anywhere between 0 and n depending on where the chart is lo- 
cated on the manifold, such that the transition maps between any two charts is 
smooth. A codimension k face Z is a connected closed subset of X such that given 
any interior point of Z there is a coordinate patch on X centered at the point of 
the form [0,1)^ x (—1,1)’^“^. The largest codimension face that occurs is called 
the codimension of X. A boundary hypersurface is the same as a codimension 
one face. For technical reasons we assume that each boundary hypersurface has 
a boundary defining function; that is, for each hypersurface H of X, there is a 
nonnegative smooth function pn G C°^{X) which vanishes only on H where it 
has a nonzero differential. Note that a manifold with corners of codimension one 
is just a manifold with boundary. Examples of manifolds with corners are found 
in Figure 5. The disk is a manifold with corners of codimension one. The square is 
a manifold with corners of codimension two; its edges are boundary hypersurfaces 
and its corners are codimension two faces. Lastly, the solid cube is a manifold with 
corners of codimension three; its sides are boundary hypersurfaces, its edges are 
codimension two faces, and its corners are codimension three faces. 

To build a geometric index theory, we first need topological/geometric data. 
We focus on manifolds with corners of codimension two. Thus let M be an even- 
dimensional, compact, oriented, Riemannian manifold with corners of codimension 
two, and let E and F be Hermitian vector bundles over M. For simplicity, we 
assume that M has exactly two boundary hypersurfaces that intersect in exactly 
one codimension two face Y. We fix a labeling Mi and M2 of the hypersur faces. 
Near each hypersurface Mi, we assume that M has a collar neighborhood M = 
[0, 1)5. X Mi where the metric is a product g = dsj hi with hi a metric on Mi, 
and where E and F are isomorphic to their restrictions Ei and Fi respectively to 
Mi. For compatibility we assume that the product decompositions near each Mi 
give a common decomposition M = [0, l)s^ x [0, l)s 2 x Y near the corner where 
the metric is a product g — dsf -h + h with h a metric on Y, and where E and 
F are isomorphic to their restrictions Eq and Fq, respectively, to Y. See Figure 6. 

Next, we need analytic/geometric data: Let 

D : C^{M,E) C^{M,F) 
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M ^ 



Ml 



0, l)si X Ml 



M ^ [0, l)s, X Ms 



Y M2 



Figure 6. The manifold M near the corner Y. On the common 
intersection of the collars, M is isomorphic to [0, 1)^^ x [0,1) S2 



be a Dirac type operator^ a first-order elliptic differential operator such that the 
principal symbol of D*D is the metric a{D* D){^) = for all cotangent vectors 
which is of product type near each hypersurface: 

(5.1) D = +A) 

on the collar M = [0, l)s. x Mi, where is a unitary isomorphism from Ei onto 
Fi, and where 

Di:C^{M,,E,)^C^{Mi,Ei) 

is a (formally) self-adjoint Dirac type operator on the odd-dimensional manifold 
with boundary M^. We assume that on the product decomposition near the corner, 
M ^ [0, 1)3, X [0, l)s2 X T, the Dirac operator takes the form 

(5.2) D = -h F2 ^s 2 + -^7 
where 

is a Dirac type operator on the even-dimensional manifold without boundary Y . 

Hidden in these assumptions are some interesting algebraic consequences at 
the corner as we now describe. Comparing (5.1) and (5.2), we find that on the 
collar M = [0, l)^^ x [0, 1)^2 x Y, we have 

Fi(^sj + A) = Fi^5^ T F2^s2 T H, z = l,2. 

Multiplying each side by F* = F“^ and solving for Di gives 

(5.3) A=rA 2^,2 +n^ and A - T* Fk9,, 4- F* H. 

Since each Di is assumed (formally) self-adjoint: D* — Di, we must have F^ F2 = 
— F2 Fi and F* J5 = F^; that is, 

(5.4) F* F, + F; F, = 2 F, = F* B, 

where Sij is the Kronecker delta. The reader familiar with Clifford multiplication 
might recognize the left equality as representing a ‘Clifford two structure’ at the 
corner. Factoring out the F* F2 from the right-hand side of Di in (5.3) gives 

A=F(a 32+Dy), where F = F*F2, Dy - F* H. 
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We call Dy the induced Dirac operator on Y. We really should call Dy the induced 
operator from Di. However, the induced operator from D 2 is related to Dy in a 
simple way. Indeed, one can verify that 

D2 = -T{ds,+DY), Dy=TDy. 

The induced Dirac operator on Y refers only to Dy and not Dy. 

As part of the ‘Clifford two package’, the induced operator Dy has a nice 
splitting property as we now describe. First, the left-hand identity in (5.4) implies 
that 

= -Id. 

Hence, T : Eq ^ Eq has eigenvalues ±i. Let E^ denote the eigenspaces corre- 
sponding to the eigenvalues ±i; these are subbundles of Eq and 

Eq = Eq 0 Eq 

is an orthogonal decomposition since T is unitary. Also, a short computation uti- 
lizing (5.4) gives 

DyT = -TDy. 

Thus Dy is odd with respect to F; hence odd with respect to the Z 2 -grading 
Eq = Eq 0 Eq . We summarize this property in the following lemma. 

Lemma 5.1. With respect to the orthogonal decomposition Eq = Eq 0 Eq , 
where E^ are the ±i eigenspaces ofT = F* F 2 , the induced Dirac operator Dy = 
FJ B takes the following form 

: C-(T, E^ 0 Eq) ^ C-(F, E^ 0 Eq), 

where Dy are the restrictions of Dy to C^(Y,E^). 

Note that since Dy is self-adjoint, we have (Dj)* = Dy. The following the- 
orem follows from the cobordism theorem of At iyah- Singer, which is published in 
Palais’ book [69]. The cobordism theorem was one of the key steps in the original 
proof of the Atiyah-Singer index theorem [6]. 

Theorem 5.2. The index of the Dirac type operator 
D+:H\Y,E+)^L\Y,E-) 

on the even- dimensional manifold without boundary Y is zero: ind Dy = 0. Since 
{Dy)* — Dy, it follows that dimkerDj — dimkerDy. 

5.2. Attaching multi-cylindrical ends. As in the manifold with boundary 
case, we cannot build an index theory of D with its natural domain on the manifold 
with corners M: 

Theorem 5.3. The Dirac type operator 

D : H^{M,E) L^{M,F) 

is never Fredholm. In fact, dimker D = 00 . 



0 Dy 
0 
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(-oo,0]s, xMi [0, l),jXMi 



Ml 

"Y 



[0, 1)., X M2 



(-oo,0]si X (-oo,0]s2 X Y 



Mo 



(-OO,0]s2 X YI 2 



Figure 7. A view of M near Y. The manifold with ‘multi-cylin- 
drical ends’ M is obtained by gluing multiple cylinders onto M. 



The corresponding theorem for manifolds with boundary (Theorem 3.1) can 
be used to prove this result. For a concrete example consider the Cauchy- Riemann 
operator Dcr = dx Yidy on the square [— 1, l]a; x [—1, 1]^. Certainly, the manifold 
and operator are both of product type. Then, ker Dcr is infinite dimensional since 
the kernel of the Dqr consists of all holomorphic functions on the square.^ 

Currently there is no suitable theory of elliptic boundary value problems for 
manifolds with corners of codimension two because the Calderon projector [ 19 ] in 
this context is not understood. However, in analogy with the case of a manifold 
with boundary, we can build an index theory through attaching multi- cylinders 
and then compact ifying again forming the corresponding 6- theory. 

We attach multi-cylinders as follows: Let M be the manifold formed by taking 
the infinite cylinder {— 00 , x Mi and attaching it onto the collar [0, l)si x Mi of 
M, then taking (— oo, 0 ]s 2 ^ ^2 and attaching it onto the collar [0, l)s 2 x Af 2 , and 
finally taking (— cx),0]sj x (— oo,0]s2 x Y and attaching it onto the remaining open 
quadrant; see Figure 7. Since all the geometric structures and the Dirac operator 
are of product type near the boundary of M, they all have natural extensions 
to the manifold M. We denote these extended structures on M using the same 
notations as were used for the original objects on M, except for the Dirac operator 
which we denote by D. 

The ‘General Principle’ (3.1) gives the following theorem (see [ 53 ] for a proof). 

Theorem 5.4. The Dirac type operator 

D : H\M,E) ^ L^{M,F) 

is Fredholm if and only if Di : H^{M^^Ei) L?{Mi,Ei) for i — 1,2, and the 
corner operator Dy : H^{Y, Eq) L‘^{Y, Eq) are each invertible. 



^Although the square hcis four corners instead of one, this example illustrates the point of 
the theorem. 
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Here, Mi is the manifold with cylindrical end formed by attaching an infinite 
cylinder to the odd-dimensional compact manifold with boundary and Di is 
the natural extension of the Dirac operator Di to Mj. 

Prom Theorem 3.3, we know that the Dirac operator on a manifold with 
a cylindrical end formed from a manifold with boundary can always be made 
Fredholm by considering it on weighted Sobolev spaces. For a manifold with corners 
of codimension two, this is not the case. 

Theorem 5.5. There exists a S > 0 such that for all 0 < \a\ < S , the Dirac 
type operator 

D : e^^H^(M,E) e“"L^(M,F) 

is Fredholm if and only if the corner operator Dy : H^{Y,Eq) L‘^{Y,Eo) is 
invertible {has zero kernel). 

See [53] or [52] for a proof. Here, each coordinate function Si is extended into 
the rest of M to be a positive bounded function there, a = (q;i,q; 2 ) is a pair 
of real numbers, 0 < |o;| < (5 means that 0 < |ai| < for i = 1,2, and finally, 
gas _ gaisi gO! 2 S 2 remark that in many cases the kernels of Dirac operators 
represent topological quantities. In these cases, the invertibility of the corner Dirac 
operator would require certain cohomology groups of the corner Y to vanish. Thus 
the Fredholm condition in Theorem 5.5 is actually very restrictive. 

5.3. Muller’s generalization of the APS index formula. We now ex- 
plain Muller’s generalization [67] of the APS formula in Theorem 3.4 to manifolds 
with corners of codimension two under the assumption that the corner Dirac op- 
erator Dy is invertible. We remove this assumption in Section 6. 

We first need to introduce the 5-eta invariants of the operators Di and D 2 , 
cf. [59, Sec. 9.7]. Consider the operator Di on Mi. Here, Mi is the manifold with 
cylindrical end formed by attaching an infinite cylinder to the odd-dimensional 
compact manifold with boundary Mi . The operator Di turns out to have contin- 
uous spectrum, and not discrete spectrum, due to the fact that Mi has infinite 
volume. Thus its eta invariant cannot be defined as a regularized signature in the 
same way as in the case of a manifold with boundary considered in Section 3.2. 
However, since the heat operator of Dl does exist, we can still try to define the 
eta invariant via the integral (3.3): 

Jo 

Unfortunately, the operator Di is not trace class, cf. Section 4.3, so the 

right-hand side is not defined, which is the reason for the quotes. However, the 
5-trace of L>i is defined.^ Replacing Tr with ^Tr in the above formula defines 



^We first compactify Mi, and then define the 6-trace as in Section 4.3. 




INDEX OF DIRAC OPERATORS 



159 



the b-eta invariant^, 

VSi) = ^/ 

V'^ Jo 

The 6-eta invariant of D 2 is defined in the same way. The APS formula in Theo- 
rem 3.4 generalizes as follows. 

Theorem 5.6 (Muller, 1996). Let D be a Dirac type operator on an even- 
dimensional, compact, oriented, Riemannian manifold with corners of codimension 
two with exactly two boundary hypersurfaces intersecting in exactly one corner and 
with product type structures specified. Then there exists a ^ > 0 such that for all 
0 < |a| < the Dirac type operator 

D : e^^H\M,E) e^^L^{M,F) 

is Fredholm if and only if the corner operator Dy • H^{Y,Eq) L‘^(V,Eo) is 
invertible (has zero kernel); in which case, 

mdaD= I Kas- \ y] |'V?(A) + signa dimker A|- 
Jm ■’ 

Miiller’s theorem in [67] technically only applies to the case of a > 0; in the 
generality presented above, the theorem is due to Melrose, cf. [53]. The formula 
for inda D is almost exactly the same as the APS formula in Theorem 3.4. In fact, 
using the 6-calculus, the proof of Theorem 5.6 proceeds in almost identical fashion 
as the proof of Theorem 3.4. The only ‘hard’ part is defining the appropriate 
generalization of 6-pseudodifferential operators and the 6-trace to manifolds with 
corners of codimension two. Once this machinery is set up, the proof of the APS 
index formula can be used to prove Theorem 5.6. 



5.4. b-version of Muller’s theorem. In analogy with the case of a mani- 
fold with boundary, we now compactify the manifold M by introducing the change 
of variables Xi — e^^ and X 2 = ^ _oq^ Xi 0, and so this change of 

variables compactifies M to be the interior of a compact manifold with corners 
of codimension two, which we denote by X. Moreover, since dsi = dxifxi and 
ds- = Xidxi^ the geometric objects on M transform into corresponding singular 
geometric ‘6-objects’ on the compact manifold with corners: 



g — ds\ + ds\ + h 



dg = ds\ ds 2 dh 
H^(M) 



(^-metric), 

_ d^ d^ (6-measure) , 

Xi X2 

H^{X) (6-Sobolev space), 



®The same discussion as in footnote (4) concerning the local index theorem on odd- 
dimensional manifolds without boundary applies in this situation too. 
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and finally, 

D = Tids^ ^2832 ^ ^ D = Ti Xidx ^ ^2 ^ 28 x 2 ^ B , 

a 6-difFerential operator. We repeat the statement of Muller’s theorem in the 
present context. 



Theorem 5.7. Let D he a Dirac type operator on an even- dimensional, com- 
pact, oriented, Riemannian manifold with corners of codimension two with exactly 
two boundary hypersurfaces intersecting in exactly one corner and with product 
type structures specified. Then there exists a (5 > 0 such that for all 0 < \a\ < 6 , 
the Dirac type operator 



D-.x'^Hl{X,E)^x^Ll{X,F) 

is Fredholm if and only if the corner operator Dy • H^{Y,Eq) L‘^{Y,Eq) is 
invertible (has zero kernel); in which case. 



ind^D= / Kas- \ Y] |^t 7 (A) + signa • dimker 5^ j. 

Jm ^ „_1 o ^ ^ 



i=l,2 



As already mentioned, with a proper generalization of 6-pseudodifferential op- 
erators and the 6-trace to manifolds with corners of codimension two, the proof of 
Theorem 5.7 proceeds in almost identical fashion as the proof of Theorem 3.4. In 
fact, the above theorem and its proof generalize to not only Dirac type operators 
but also 6-pseudodifferential on manifolds with corners of arbitrary codimension 
(see [50, 51, 52, 53]). These generalizations are due to Melrose (for Dirac op- 
erators) and the author (for 6- pseudodifferential operators), cf. Lauter and Mo- 
roianu [44] for the cusp case. The ability to handle arbitrary codimensions is a 
nice feature of using 6-pseudodifferential operators to attack index problems on 
manifolds with corners. 



5.5. Some remarks on index theory on manifolds with corners. In 
[75] Salomenson builds an index theory for Dirac operators on manifolds with 
corners of codimension two by attaching cylinders in a very different way than 
considered here. Instead of attaching separate cylinders to each hypersurface Mi 
and then filling in the lower quadrant with a product cylinder as shown in Fig- 
ure 7, he notes that 8 M has a natural smooth structure and attaches the cylinder 
(—00,0] X 8 M onto M. This creates a manifold with cylindrical end like in the 
case of a manifold with boundary, except that it has a ‘wedge singularity’ at the 
original corner Y. Results of Cheeger [22] or Chou [24] can be used to handle the 
wedge singularity. 

In a different direction, Hassel, Mazzeo, and Melrose [41] prove a signature 
formula for manifolds with corners of codimension two. Unlike the signature formu- 
las for manifolds with and without boundary, which are direct corollaries of index 
formulas on such manifolds, the HMM formula is not a consequence of an index 
formula on manifolds with corners of codimension two. Instead, they round off the 
corner and consider X as a limit as ^ 0 of manifolds with smooth boundary . 
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The resulting signature formula is obtained by a careful analysis of the limit of the 
APS signature formulas of each X^. They rely on ‘analytic surgery’ techniques in 
[40] to identify the limiting formula. Wall [84] considers a manifold with boundary 
divided into two parts, each a manifold with corners of codimension two (e.g., a 
disk divided into two half wedges). Although not an index formula per se, Wall 
gives a formula for the signature of the manifold with boundary in terms of the 
signatures of the two manifolds with corners of codimension two and a correction 
term given by the Maslov index of certain Lagrangian subspaces, cf. Section 6. 

6. Perturbations of Dirac operators on manifolds with corners 

We now consider the APS index formula for manifolds with corners of codi- 
mension two dropping the invertibility assumption on the corner Dirac operator. 
From our experience with the Gauss-Bonnet formula in the introduction, we expect 
there to be a correction term added to the right-hand side of the APS formula due 
to the presence of the corners. Theorem 5.6 did not have a corner contribution, 
essentially because the invertibility of the corner Dirac operator Dy makes the 
Dirac operator D not ‘notice’ the presence of the corners. For the Gauss-Bonnet 
formula, the correction term was given by the exterior angles of the corners. For 
the APS formula without the invertibility assumption on the corner operator, there 
is a correction term in the index formula and it represents an ‘exterior angle’ of 
sorts between certain Lagrangian vector spaces. In this section, we use the same 
notation as in Section 5. 

6.1. Fredholm perturbation of Dirac operators. By Theorem 5.5, there 
exists a (5 > 0 such that for all 0 < \a\ < S, the Dirac type operator 

D:x^HUX,E)^x^LUX,F) 

is Fredholm if and only if the corner operator Dy ■ H^{Y,Eo) — » E^{Y,Eo) is in- 
vertible (has zero kernel) . This nondegeneracy condition is actually very restrictive 
since in many cases the kernels of Dirac operators represent cohomology. However, 
we now show that it is always possible to make D Fredholm on weighted Sobolev 
spaces by perturbation with 5-smoothing operators. 

To define these perturbations we recall some notation from Section 5.1. The 
manifold with corners of codimension two M is assumed to have exactly two bound- 
ary hypersurfaces Mi and M 2 that intersect in exactly one codimension two face 
Y. Near the corner Y the Dirac type operator D takes the form 

D = T ids^ + ^ 2^82 + 

where 

B:C^{Y,Eo)^C^{Y,Fo) 

is a Dirac type operator on the even-dimensional manifold without boundary Y, 
The induced operator Di on the hypersurface Mi takes the form 

(6.1) Di=T{d 82 YDy), r-rtF2, Dy=riB, 
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and the operator D 2 on M 2 takes the form 

(6.2) D 2 = -T{ds, + 5y), Dy = TDy. 

The minus sign in front of F and the fact that Dy — TDy will come into play 
later. Also, see Lemma 5.1, ^0 = Eq 0 Eq where Eq are the ±i eigenspaces of 
r = r* F 2 , and the induced Dirac operator Dy = T^B is odd with respect to F 
and so decomposes as 

: C°° {Y, E+ (Y, E+ ®E^), 

where Dy are the restrictions of Dy to Eq). Moreover, see Theorem 5.2, 

D^:H\Y,E^)-^L\Y,E^) 

has index zero; that is, dimkerDj = dimkerDy. 

We now define the perturbations. Since the kernel of the Dirac type operator 
Dy is exactly the obstruction to D being Fredholm on weighted Sobolev spaces, 
the perturbations are chosen to be isomorphisms on the kernel. Since Dy is odd 
with respect to F, we only consider isomorphisms on kerDy having the same 
property. Thus, let T : kerDy — > kerDy be a self-adjoint unitary isomorphism 
that is odd with respect to F. Hence T decomposes as an odd matrix 

: ker Dy 0 ker Dy ker Dy 0 ker Dy , 

where : kerDy kerDj are unitary isomorphisms with respect to the 
inner product on kerDy C L‘^{Y,Eq). Such an operator T exists because 
dim ker Dy = dim ker Dy. We can define T explicitly as follows. Let 
and be orthonormal bases of kerDf and ker Dy, respectively. By elliptic 

regularity, Uj, Vj G Do) for every j. Then, 

N N 

T = ^ Uj 0 Vj 0 ^ Vj 0 Uj 

j=i i=i 

defines a self-adjoint unitary isomorphism on ker Dy that is odd with respect to 
F and any such T can be written in this way for some choice of bases. Moreover, 
this formula shows that T is a smoothing operator on Y. Obviously, 

Dy-T:H\Y,Eq)^L^(Y,Eo) 

is invertible. This suggests that if we can extend T to an operator T on X, then 

D - f ■. x°‘Hl{X,E) ^ x°‘Ll{X,F) 

is Fredholm for all 0 < |a| < <5 for some > 0. To extend T, we first define T 
on the manifold with multi-cylindrical ends M. Let x ^ 1)^) ^6 such that 



0 T~ 
T+ 0 



0 Dy 
D+ 0 
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X{x) — 1 for a: near zero. Then x(^^) == can be regarded as a smooth 

function on M supported on the cylindrical end (cf. Figure 7) 

(-oo,0]s, X (-oo,0]s2 X 

Let (^(^ 1 ,^ 2 ) = Then, given any u G C^{M, E), we define 

(6.3) Tu{s,y) =x{e^)'T2-77^ [ d^, 

(27t) Jr2 

where ^ is the Fourier transform of x(c^) u{s, y) with respect to s: 

^(4. y) = 7 ^-^ [ x(e") m(s, y) ds. 

(27t)'^ Jr2 

The reason for the factor of F 2 on the right-hand side of Tit is that T is required to 
map sections of E to sections of F and the F 2 factor provides this property. Note 
that the operator T in the definition of T only acts on the y variable of 
Regarded as an operator on the compactified manifold X under the change of 
variables Xi = , the operator T is an example of a ^-smoothing operator; that 

is, a 6-pseudodifferential operator of order — 00 . The mapping properties of such 
operators (cf. [ 59 , Ch. 5]) imply that 

f : x°‘H^{X, E) ^ x°‘Hi{X, F) for all a, fc, L 

The next result follows from the properties of 6-pseudodifferential operators and 
the fact that Dy — T : i7^(T, £* 0 ) is invertible, cf. [ 52 , 53 ]. 

Lemma 6.1. There exists a 6 > 0 such that for all 0 < |o;| < 6, 

D-f :x^Hl{X,E) ^x^Ll{X,F) 

is Fredholm. 

6.2. An index formula for perturbed Dirac operators. We now give a 
formula for the index of Z) — T. Before doing so, we need to review the ‘scattering 
Lagrangian’ of each operator Di. Consider the operator Di on Mi. Recall that Mi 
is formed by attaching an infinite cylinder (— co, 0]52 x T to the odd-dimensional 
compact manifold with boundary Mi . The set 

Aci = I lim u{s 2 ,y ) ; u g C^(Mi,£) is bounded, and Diu = 0 > 

is called the scattering Lagrangian of D\ . It turns out that A^i C ker Dy and the 
dimension of Acj is exactly one-half the dimension of ker Dy, cf. [ 59 , Sec. 6.5]. The 
scattering matrix of Di is the operator Ci : kerDy — > kerDy defined by Ci = +1 
on Aci and (7i = — 1 on A^^, where ‘J_’ means the orthogonal complement with 
respect to the inner product. Then Ci is odd with respect to F, cf. [ 65 , Sec. 4]. 
The scattering Lagrangian Ac 2 and the matrix C 2 of D 2 are defined in the same 
way. In [ 53 ] we give the following formula for the index oi D — T: 
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Theorem 6,2 (Loya-Melrose, 2002). Let D be a Dirac type operator on an 
even- dimensional, compact, oriented, Riemannian manifold with corners of codi- 
mension two with exactly two boundary hypersurfaces intersecting in exactly one 
corner and with product type structures specified. Let T : kev Dy kei Dy be a 
self-adjoint unitary isomorphism that is odd with respect to T and let T be the per- 
turbation defined by (6.3). Then there exists a S > 0 such that for all 0 < |o;| < S, 
the perturbed Dirac operator 



D-f: E) x°‘Ll{X, F) 



is Fredholm. Moreover, if its index is denoted by inda(£> — T), then 



(6.4) 



ind„(5-f)= / Kas 
Jm 



I E i) + sign a • dim ker Df | 

i=l,2 

-Cc(At, Aci, AC2)* 



The first line on the right-hand side is the same as in Theorem 5.7; the third 
‘corner correction term’ is described as follows. First, Ay C kerjDy is the +1 
eigenspace of the matrix T (since T is a self-adjoint unitary isomorphism, = Id, 
so T has eigenvalues ±1). Then, 

(6.5) c„(Ax, Aci, Acj) =signa- { dim(AT n AcJ + dim(ArT n Acj)} +r]{Dg), 



where Apr C ker Dy is the -hi eigenspace of the self-adjoint unitary isomorphism 
FT and r]{Dg) is the eta invariant of a Dirac operator on a directed graph Q 
defined as follows, cf. [ 41 ], [ 55 ], [ 20 ], [ 47 ]. This graph has two vertices vi and V 2 
representing the hypersurfaces M\ and M 2 , respectively, and two edges ei 2 and 
621 connecting the vertices representing the single corner Y . To put a manifold 
structure on this graph, we identify Cjk with the interval [— 1 , l]t, where the vertex 
Vj corresponds iot = —l and the vertex to t = -\-l. We consider V = kev Dy 0 
ker Dy as a ‘vector bundle’ over Q where the first and second factors of ker Dy 
are ‘fibers’ over the edges Ci 2 and 621 , respectively. Thus a section of this vector 
bundle is a sum S12 0 521, where sjk : ejk = [—1, 1] ^ kerDy. We define a Dirac 
operator Dg acting on sections of Q by 



_ ^ d , ^ d s 



The minus sign in the second term stems from the minus sign in (6.2). The domain 
of Dg consists of those sections S12 0 S21 such that Si2{vi) G Ay, Si2{v2) G Aci, 
and 521(^2) G Apt, S2i{vi) G The Lagrangian Apr paired with the scattering 
Lagrangian Ac 2 stems from the fact that Dy = TDy in (6.2). The term rj{Dg) 
appearing in (6.5) is then the eta invariant of Dg. 

Lesch and Wojciechowski [ 47 ] give the following linear- algebraic form for the 
eta term: 



r]{Dg) — m(AT, Aci) - m(ApT, AC 2 ), 
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where 

m(ALj,Az,J = -^ Y2 

27T 

e^^espec{-L~ L+) 

0e( — 7T,7r) 

for any given self-adjoint unitary isomorphisms Li, L 2 on ker Dy that are odd 
with respect to T, and with ALi C kerDy denoting the -hi eigenspace of Li, The 
number m{AL^ ^Al^) can be interpreted as an ‘exterior angle’ of sorts between Al^ 
and Al 2 5 cf, [48], [20], [18]. Hcissel, Mazzeo, and Melrose [40, 41] give a somewhat 
more sophisticated linear-algebraic description of the eta term. 

Theorem 6.2 is proved as follows: First, following the proof of Theorem 5.7, 
which uses similar arguments found in Section 4, produces the formula 



ind„(5-f)= f Kas-\ 
J M ^ 



- fi) + signQ ■ dimker(A - T,)|, 

i=l,2 



where Ti is an operator naturally induced by T on The second and most 
difficult part of the proof is to show that the terms involving Di — Ti in this 
formula decompose as in (6.4). To do this, we show that 



dimker(il^ — Ti) = dim ker -h dim(AT. n A^J, 
where Ti = T and T 2 = FT, and that 

- fi) = "r?(A) ± m(Ar,, Ac.), 

where the sign is positive or negative if z = 1 or i = 2, respectively. The de- 
composition of the 6-eta invariants uses techniques that have been developed by 
many authors concerning gluing/splitting formulas for eta invariants, e.g. Briining 
and Lesch [17] (cf. Vishik [83]), Douglas and Wojciechowski [28], Lesch and Wo- 
jciechowski [47], and Muller [65]. For related works on the eta invariant, see 
Singer [80], Bunke [18], Dai and Freed [26], and Hassel, Mazzeo, and Melrose [40]. 



6.3. Some concluding remarks. If M has more than one corner, the result 
from Theorem 6.2 still holds (with minor changes in the index formula accounting 
for the various faces and corners) as long as we assume that each corner Dirac 
operator has index zero [53] . This assumption allows us to construct separate per- 
turbations for each corner, then sum these perturbations producing a 6-smoothing 
operator giving a Fredholm perturbation of the Dirac operator, Melrose and Nistor 
show that it is in fact necessary that each corner operator have index zero for the 
existence of a 6-smoothing Fredholm perturbation. However, using a slightly larger 
class of perturbations called ‘overblown’ 6-smoothing operators, it is possible to 
make Fredholm perturbations without any assumptions at the corners [54]. 

Current plans include relating the index of the perturbed Dirac operator to 
an index of the Dirac operator on a domain depending on the choice of perturba- 
tion. The index should be a type of Carron index [21]. In future work, we expect 
to generalize the program of ‘overblown’ 6-smoothing Fredholm perturbations of 
Dirac operators to manifolds with corners of arbitrary codimension. Finally, one 
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of the ultimate goals of this project is to derive via an index computation an an- 
alytic formula for the topological signature of any compact manifold with corners 
of arbitrary codimension in terms of geometric and other types of invariants of the 
manifold and its boundary faces. 
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Index defects in the theory of spectral 
boundary value problems 

Anton Savin and Boris Sternin 



Abstract. We study index defects in spectral boundary value problems for 
elliptic operators. Explicit analytic expressions for index defects in various 
situations are given. The corresponding topological indices are computed as 
homotopy invariants of the principal symbol. 



Introduction 

The classical Hirzebruch formula 

(0.1) signM=/ L{pi,p 2 ,...,Pk) 

Jm 

expresses the signature of a closed oriented 4/c-dimensional manifold in terms of its 
Pontryagin characteristic classes. From the viewpoint of elliptic operator theory, 
formula (0.1) expresses the index of a specific elliptic operator (later called the 
Hirzebruch operator) via stable homotopy invariants of its principal symbol. (For 
the Hirzebruch operator, these invariants coincide with the Pontryagin classes of 
the manifold.) 

Unfortunately, formula (0.1) has no immediate analog for manifolds with 
boundary: there are examples showing that the signature of such a manifold cannot 
be expressed in terms of Pontryagin classes. 

In 1973, Hirzebruch [Hir73] considered a class of manifolds with boundary 
(arising from algebraic-geometric considerations on Hilbert modular varieties) that 
have naturally defined relative Pontryagin classes. Although the right-hand side 
of (0.1) makes sense in this case, the equality in (0.1) fails. The difference between 
the right- and left-hand sides was called the signature defect^ and the problem was 
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to compute it, i.e., find a function / of the boundary of the manifold such that 
the difference 



signM-/(aM) 

can be expressed via Pontryagin classes of the manifold, or, in the language of 
elliptic theory, via the principal symbol of the Hirzebruch operator. 

Hirzebruch conjectured a formula for f{dM) and proved it in a number of 
examples. A complete solution of the signature defect problem was given later by 
Atiyah-Donnelly-Singer [ADS83] and Muller [Miil84]. 

The aim of the present survey is to describe index defects for some natural 
classes of general elliptic operators on manifolds with boundary. We consider only 
boundary value problems. Note, however, that index defects also occur in com- 
pletely different situations, e.g., for elliptic operators in pseudodifferential sub- 
spaces of Sobolev spaces (rather than in Sobolev spaces themselves) on compact 
closed manifolds (see [SS99, SSOO]). Here we deal with two classes of opera- 
tors important in applications, namely, operators satisfying Gilkey’s parity con- 
dition [Gil89a] and operators on Z^-manifolds in the sense of Freed and Mel- 
rose [FM92], and give explicit index defect formulas in both cases. 



The classical theory: The Atiyah— Singer and Atiyah— Bott index for- 
mulas. 

The Atiyah— Singer formula on closed manifolds. Let D be an elliptic 
operator, say, in Sobolev spaces on a closed manifold M. It is well known that 
D is Fredholm. The celebrated Atiyah-Singer theorem [AS68] gives a topological 
formula for the index indD in terms of the principal symbol <j{D). By applying 
the difference construction to the principal symbol, one obtains an element 

[a{D)] G Ae(T*M) 

in the A-group with compact supports of the cotangent bundle . The Atiyah- 
Singer formula reads 

(0.2) indD = mdt[cr{D)], 

where indt[cr(D)] is a functional of the principal symbol of the operator which can 
be written out in closed form. In other words, the Atiyah-Singer formula expresses 
an analytic invariant of the operator (the index) in terms of topological invariants 
of the principal symbol. 

The Atiyah— Bott index formula for boundary value problems. If the 

boundary dM is not empty, then the operator D is no longer Fredholm (one can 
show that it always has an infinite-dimensional kernel), and one should equip it 
with boundary conditions to obtain a well-posed problem. The classical boundary 
conditions are most natural. 
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A classical boundary value problem is a system of equations of the form^ 



(0.3) 



Du = /, 
B{u\9m)=9, 



where u and / are functions on M and g is a. function on dM. The operator B in 
the boundary condition is a differential operator; it is applied to the restriction of 
the unknown function to the boundary. 

The ellipticity condition for problem (0.3) (see [H6r85]) can be stated in terms 
of the principal symbols cr{D) of the operator and cr{B) of the boundary condition. 
Atiyah and Bott [AB64] showed that the index theory of classical boundary value 
problems is similar to that of elliptic operators on closed manifolds. Namely, under 
the ellipticity condition, problem (0.3) defines a difference element 



[a{D,B)]eK,{T^M\dM)), 



where T*{M \ dM) is the cotangent bundle over the interior of M, and the index 
of the corresponding Fredholm operator is given by the formula 



(0.4) ind(D, B) = mdt[a{D, B)], 

similar to (0.2). An index formula of the same structure can be obtained for 
boundary value problems in the pseudodifferential setting introduced by Boutet 
de Monvel [BdMTl]. A detailed exposition can be found in the book [RS82]. For 
simplicity we consider only classical boundary value problems. 

However, the theory of classical boundary value problems has an essential 
drawback. For some operators, there are no well-posed^ classical boundary condi- 
tions at all\ 

Atiyah and Bott showed that the obstruction to the existence of well-posed 
boundary conditions is of topological nature and computed it. The obstruction 
proves to be nonzero for most geometric operators: the Dirac operator, the Hirze- 
bruch operator, and the Cauchy-Riemann operator. In other words, there are no 
Fredholm classical boundary value problems for these operators. 

It is still possible to sidestep the obstruction and, in particular, equip the 
above-mentioned operators with well-posed boundary conditions. To this end, one 
has to consider a more general class of boundary value problems, namely, so-called 
problems in subspaces, which are described in the next subsection. 



Boundary value problems in subspaces. Spectral problems. A bound- 
airy value problem in subspaces is a boundary value problem of the form 



(0.5) 



Du = /, 

^HdM)=9, 5€lmP, 



'^To simplify the presentation, we consider first-order operators and occasionally speak of 
functions instead of sections of vector bundles. 

^That is, defining a Fredholm problem for the original differential expression D in suitable 
spaces. 
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where the right-hand side g of the boundary condition lies in the range 

ImPc C^{dM,G) 

of a pseudodifferential projection operator 

P : C^{dM, G) G^{dM, G) 

in the function space on the boundary and the boundary operator B is also pseu- 
dodifferential. This class of boundary value problems was introduced in [SSS98] 
and further studied in [NSSS98, SSSOl, SSS99b]. In particular, it was shown 
that the ellipticity condition can be stated in terms of the principal symbols of Z>, 
B, and P, just as in the classical case. However, from the topological point of view 
these problems are opposite to classical boundary value problems. 

The two most important differences are as follows. 

I. There exists a Fredholm boundary value problem in subspaces for an arbi- 
trary elliptic operator. An example is given by the spectral Atiyah-Patodi-Singer 
boundary value problem [APS 75]^ 



(0.6) 



Du = f, 

U+{A)u\aM=g, 5GlmII+(^). 



Here P is a first-order operator assumed to have the form 



(0.7) 



D 









in a collar neighborhood Uqm of the boundary, where A is an elliptic self-adjoint 
operator called the tangential operator of P, and H-(_(A) is the spectral projection 
of A on M+, i.e., the orthogonal projection on the subspace spanned by eigenvectors 
of A with nonnegative eigenvalues. 

An arbitrary boundary value problem in subspaces can be reduced to a spectral 
problem by a stable homotopy (see [SS99, SSS99b]). Therefore, topologically, 
problem (0.6) can be viewed as the general case of a problem in subspaces. Thus, for 
simplicity we consider only spectral problems (0.6) for operators P satisfying (0.7). 
By ind(P,H+(A)) we denote the index of problem (0.6). 



II. The index of a boundary value problem in subspaces is not determined by 
the principal symbol of the operator P. To illustrate this, consider a deformation 
of lower-order terms of P such that some eigenvalue of the tangential operator 
changes its sign. At this point, the spectral projection H+(A) experiences a jump, 
so that the index of the problem may change. On the other hand, the index re- 
mains constant as long as the deformation produces continuously varying spectral 
projections. Let us give a simple example. 

Consider the zero-order deformation 



Dr=D + Tx{t) 



^Atiyah, Patodi, and Singer used only homogeneous boundary conditions. However, prob- 
lem (0.6) is equivalent to the corresponding homogeneous problem as far as the solvability and 
the index problem are concerned. 




174 



ANTON SAVIN AND BORIS STERNIN 



of the Cauchy-Riemann operator 



D = 



^ A 

dt d(f 



on the cylinder x [0, 1], where x(^) is a smooth function such that x(0) = 1 and 
^(1) = 0. The tangential operator of the family Dr depends on r only on one of 
the bases of the cylinder, namely, on x {0}, where it has the form 



Ar 



. d 



+ T. 



The eigenvalues of Ar are given by the formula r + 27m, n G Z. As r passes 
through zero, one of the eigenvalues changes its sign, so that the spectral projection 
undergoes a jump. The index is also discontinuous: 



md{Dr,U^{Ar)) ^ { 



- 2 , 

- 1 , 

0 , 



— 27t < r < 0, 
r = 0, 

0 < r < 27T. 



This example makes it clear that one cannot obtain an index formula simi- 
lar to (0.4) for spectral boundary value problems; in other words, a topological 
computation of the index in this case is impossible in principle. 



Remark 0.1. The spectral boundary value problems are intimately related 
with the theory of elliptic operators on manifolds with singularities. Indeed, 
Atiyah-Patodi-Singer showed that if the tangential operator is invertible then 
the index of the spectral problem (0.6) coincides with the index of the extension 
D oi D to M with the infinite cylinder attached to the boundary: 

M = M U [0, oo) X dM 

and the operator is translation invariant on the cylinder. If we now make the 
change of variables r = then D becomes a Fuchs degenerate operator at r = 0: 

d 

r— + A. 
or 

Operators of this form are studied in the elliptic theory on manifolds with isolated 
conical singularities (see e.g. [Les97, Mel93, Sch91]). 

The index and the index defect for spectral problems. The aim of this 
survey is to show that in many cases of interest one obtains a homotopy invariant 
of the principal symbol of the operator by adding some analytic invariant to the 
index of a spectral boundary value problem. 

The correction term is naturally called an index defect of the problem, since 
it is this term that restores the homotopy invariance of the index. It is natural 
to require that the correction term be determined solely by the structure of the 
operator in a neighborhood of the boundary, for on closed manifolds the analytic 
index itself is homotopy invariant and zero can be taken for the correction term. 

Therefore, we introduce the following statement of the index defect problem. 
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The index defect problem for spectral boundary value problems. 

Construct a functional def-ind(D) of elliptic operators D on a manifold with 
boundary such that 

(1) the sum ind(i^, n+(^)) + def-indZ) is a homotopy invariant of 

(2) def-ind(i)) is determined solely by the tangential operator A. 

A functional with these properties will be called an index defect. Conditions (1) 
and (2) imply that the index defect is determined by the spectral projection and is 
its homotopy invariant. 

Needless to say, to obtain an actual defect formula (which is our main prob- 
lem), we should compute the homotopy invariant in (1) topologically, i.e., express 
it in the form 

(0.8) ind(D, n+(v4)) -t- def-indL) = indf (<j(D)), 

where indt (rr(D)) is a functional on the set of homotopy classes of elliptic principal 
symbols. 

In the remaining part of the introduction, we explain the main methods that 
can be used to define index defects and describe approaches to the proof of the 
corresponding index defect formulas (0.8). However, prior to proceeding to these 
topics, we consider the following phenomenon of utmost importance. 

The obstruction to index defect formulas. The desired index defect for- 
mula (0.8) can be viewed as a decomposition of the index of a spectral boundary 
value problem into a finite-dimensional contribution of the principal symbol and 
an (infinite-dimensional) contribution of the tangential operator: 

(0.9) md{D,U^{A))=^h{a{D)) + f2{A), 

where the functional fi is a homotopy invariant of the principal symbol. 

It turns out that there is no index decomposition of the form (0.9) on the 
set of all elliptic operators (see [SSS99a]). Therefore, index defect formulas and 
decompositions of the form (0.9) can be sought only in some subsets of the space 
of elliptic operators on a manifold with boundary. 

The obstruction to the existence of decompositions (0.9) was computed in 
[SSS99a]. It is the one-dimensional cohomology class of the space of elliptic op- 
erators whose value on a cycle is equal to the Atiyah-Patodi-Singer spectral flow 
of the corresponding family of tangential operators. There exists a decomposi- 
tion (0.9) on a subspace E of the space of elliptic operators if and only if the 
restriction of this cohomology class to E is trivial. 

The cited result, unfortunately, proves only the existence of a decomposi- 
tion (0.9) and does not give a satisfactory formula for an index defect. To study 
index defects, one has to use other methods. 



4 



It readily follows that the sum is a homotopy invariant of the principal symbol of D. 
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Approaches to the definition of index defects. Let us briefly describe 
two methods useful in defining index defects, 

A. The geometric index formula of Atiyah— Patodi-Singer. In 1975, 
Atiyah-Patodi-Singer [APS76a] obtained the formula 

(0.10) md{D,U^{A))^ [ a{D)-rj(A) 

Jm 

for the index of spectral boundary value problems, where the density a{D) is 
determined by the coefficients of D, just as in the case of closed manifolds. The 
new contribution to the index is given by the spectral ? 7 -invariant 77 (A) of the 
tangential operator A. 

This formula is often called a geometric index formula^ since for geometric 
operators (the Hirzebruch, Dirac, Todd and Euler operators) the integrand on the 
right-hand side is determined by the metric and coincides with the local Atiyah- 
Singer density in the case of closed manifolds (i.e., with the L-form for the Hirze- 
bruch operator, the A-form for the Dirac operator, etc.). An extension of the 
Atiyah-Patodi-Singer formula has been obtained by Melrose and Nistor [MN96] 
(see also [LM02]) for elliptic operators on manifolds with isolated singularities. In 
particular, an extension of the ? 7 -invariant to pseudodifferential operators is known 
(see [Mel95]). 

Unfortunately, the Atiyah-Patodi-Singer formula does not define an index 
defect, since neither of the terms on the right-hand side is a homotopy invariant 
of D. However, formula (0.10) can be used to define index defects as follows. 

We have already pointed out that the index of the spectral boundary value 
problem experiences jumps under homotopies of D. However, the sum 

(0.11) ind(D,H+(A))-hry(A) 

varies smoothly by the Atiyah Patodi-Singer theorem. Moreover, the sum (0.11) is 
homotopy invariant if and only if for an arbitrary homotopy (with parameter r) 
in our class of operators the derivative 

( 0 . 12 ) ~ [ a{Dr) 

dr 

is zero. Since the density a{Dr) is given by a closed- form expression involving the 
coefficients of D^-, one can use a detailed analysis of a{Dr) to construct classes of 
operators for which the derivative is zero and hence the 77 -invariant of the tangential 
operator is the desired index defect. 

B. Operator algebras. Another method for defining index defects relies on 
A- theory of operator algebras. 

As was mentioned already, any index defect is determined by the spectral 
projection H-^(A) and is its homotopy invariant. For simplicity, consider the class 
of matrix projections 

(0.13) n+(^) : C°°{dM, C^) — > C°°{dM, C^) 
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and assume that the matrix entries lie in some algebra A of operators on the 
boundary. 

Then index defects admit an alternative description as homotopy invariants 
of projections. 

Recall that the K- group Kq{A) of the algebra A (e.g., see [Bla98]) is just 
the Grothendieck group of the Abelian semigroup of homotopy classes of projec- 
tions (0.13) with entries in A (for arbitrary N). Thus, an index defect functional 
defines a homomorphism 

d : Kq{A) R 

of the AT-group into real numbers. 

Moreover, a simple computation shows that the homotopy invariance of the 
sum ind(D, n.f (A)) + d(II+(A)) is equivalent to either of the following two con- 
ditions for the functional d (provided that A contains the ideal of finite rank 
operators) . 

(1) The functional d is a dimension type invariant of projections. More pre- 
cisely, for two arbitrary projections 

Pi, 2 , ImPiClmP 2 , dimIm(P 2 - Pi) < oo, 
differing by a finite rank projection P 2 — Pi , one has 
d(P 2 ) - d(Pi) = dimIm(P 2 - Pi). 

(2) The functional d defines a commutative diagram 

(0.14) Ko{JC) - Z 




where the diagonal arrow is the natural embedding Z C R. 

Examples. Now we consider some explicit implementations of the methods. 
Each example starts with a description of the class of operators for which the index 
defect is to be considered. 

Example 0.2. Problems in even subspaces [SS99]. Consider operators 
D such that the symbol of the tangential operator is even in the momentum 
variables 

This condition singles out the subalgebra of operators with even principal symbol 
in the algebra of pseudodifferential operators on the boundary. In this subalgebra, 
consider the subalgebra A of zero-order operators. If dM is even- dimensional^ 
then the vertical arrow in diagram (0.14) is a monomorphism, which implies the 
existence of the desired functional d. One can also prove that d is unique under 
some natural conditions. 
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Thus, there is a well-defined homotopy invariant d{P) G M on the set of 
pseudodifferential projections P with even principal symbol. In contrast with the 
index of elliptic operators, this functional is not integer; it can take arbitrary 
rational values whose denominators are powers of 2 (dyadic values) see [SS03]. 

Thus, the value of the dimension functional d on the spectral projection can 
be taken as the index defect for operators D whose tangential operator A has an 
even principal symbol. In other words, the sum 

ind(D,n+(^)) + d(n+(yi)) 

is a homotopy invariant of D. This poses a problem of computing this invariant in 
terms of the principal symbol of D. In the next subsection, we explain the main 
ideas underlying the computation of this invariant. 

Example 0.3. Spectral problems on Z^-manifolds [SSOl]. Consider a 
manifold M whose boundary is represented as the total space of a covering 

7T : 5M — > X 

over a smooth base X. Geometrically, such a manifold can be viewed as a smooth 
model of the singular space M (known as a Zn-TucLTiifold^ where n is the number 
of sheets of the covering) obtained by identifying the points in each fiber of tt. 
A neighborhood of a singular point looks like an open book with n sheets (see 
Fig. 1), and X C M is the edge, where the sheets meet. 

On M we consider elliptic operators whose tangential operator A is the lift by 
TT of some operator Aq on the base of the covering. (The lift is well defined, since 
TT is a local diffeomorphism.) 
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For a trivial covering, this condition guarantees that the index of the corre- 
sponding spectral boundary value problem viewed as the mod n-residue 

mod n- ind D ^ Zn 



is a homotopy invariant of D. Freed and Melrose [FM92] obtained the mod n- index 
formula 

mod n- ind D = ind^ [<j {D )] , 



where 

[a{D)]eKc{T^") 

is the difference element defined by the principal symbol of D in the /("-group of 
the singular space T*M obtained from the cotangent bundle T*M by identifying 
the points in each fiber of the covering dT*M — > T*X x M, by analogy with the 
definition of M . 

However, the modn-index is not an invariant of the principal symbol if the 
covering is nontrivial. The index defect in this case turns out to be given by the 
difference 

def-ind(Z)) rj {A) — nrj{AQ) G R/nZ. 

An expression of this type is known as the relative Atiy ah- P at odi- Singer r] -in- 
variant [APS 76b] of an operator Aq with coefficients in a flat bundle. The index 
defect problem in this case is to compute the homotopy invariant 



mvD = mod n- ind D + def-ind D G R/nZ 



as a residue modulo n. 



Approaches to index defect formulas. To state and prove an index defect 
formula, one can apply all methods that are useful in the proof of ordinary index 
formulas. We content ourselves with describing only two approaches. 

Method 1. Homotopy classification. 

Roughly speaking, the method consists of two steps. 

(1) First, one carries out the homotopy classification of elliptic operators 
D to be considered, or, more technically, computes the group of stable 
homotopy classes of these operators. 

(2) Second, one finds a generating set of this group, so that the proof of an 
index defect formula is reduced to its verification for the generators. 

This scheme goes back to the first proof of the Atiyah-Singer formula [AS63] , 
where elliptic operators are classified (modulo stable homotopies) by elements 
of the A-group Kc{T*M) of the cotangent bundle at step (1), the Hirzebruch 
operator with coefficients in various vector bundles gives a rational generating 
set of the A-group (on an orientable even-dimensional manifold) at step (2), and 
finally cobordism theory is used to compare the analytic and topological index of 
these geometric operators. 
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Method 2. Poincare duality. 

Another method for proving index formulas is based on Poincare duality in 
K-theory. Let us illustrate this method using the classical Atiyah-Singer theorem 
as an example. 

On a closed manifold, there is an index homomorphism 
(0.15) inda : A'e(T*M) — > Z, 

which takes each element of K-theory to the (analytic) index of the corresponding 
elliptic operator. On the other hand, Poincare duality in K-theory gives the pairing 

(,):i^c(T*M)x A(M)^Z, 

{x,y)^p,{xy), 

which is nonsingular on the free parts of the groups. Here 

P! : Kc{T*M) — ^ Z 

is the direct image mapping induced by the projection p : M ^ pt to a, one-point 
space. It follows that the homomorphism (0.15) can be represented as the pairing 
with some element y G K(M); i.e., 

ind£> = {[a{D)],y) 

for all elliptic operators D, where y is uniquely determined by M modulo torsion. 
Therefore, to obtain an index formula, it suffices to compute the element y. In 
these terms, the Atiyah-Singer formula states that one can take y = 1 ^ K{M)^ 
the element corresponding to the trivial line bundle. 

Let us show how one can apply these methods to find and prove index defect 
formulas. 

Continuation of Example 0.2 (an index defect formula in even sub- 
spaces). 

We consider operators D with even principal symbol of the tangential opera- 
tor on an even-dimensional manifold M. The homotopy classification of the cor- 
responding spectral boundary value problems turns out to be isomorphic (mod- 
ulo 2- torsion) to that of classical boundary value problems, i.e., to the group 
Kc{T*{M \ dM)). Therefore, to obtain a topological formula for the homotopy 
invariant 

invD = ind(D,n+(A)) -hd(H+(A)), 

it suffices to generalize the Atiyah-Bott topological index (0.4) to boundary value 
problems in even subspaces. Such a generalization was obtained in [SS99]. We 
point out that the topological index in this formula proves to be a half- integer, 
and a topological consequence of this formula is the half- integrality of the index 
defect. The index defect formula has a number of applications. For example, it 
enabled the authors [SS02] to solve Gilkey’s problem on the nontriviality of rj- 
invariants of even-order operators on odd-dimensional manifolds. 
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Continuation of Example 0.3 (an index defect formula on Z^- manifolds). 

For a manifold whose boundary is an n-sheeted covering, the sum 

Hp>f 

invD = mod n- ind D + def-ind D 
can be viewed as a homomorphism 
(0.17) inv : Kc(T^^) — > M/nZ, 

The two main differences between (0.17) and (0.15) are as follows: 

(1) now we use the group M/nZ rather than E; 

(2) the space T*M has singularities. 

To take account of (1), one should replace the classical Poincare duality (0.16) 
by “Poincare duality with coefficients,” i.e., Pontryagin duality 

(0.18) (, ) : Kc{T*M) x K(M, M/Z) ^ E/Z. 

(See [SS02]; here K(M, E/Z) is the K-group with coefficients in the compact 
group E/Z.) 

To tackle (2), one needs an extension of Poincare duality to singular manifolds 
like M^. We point out that duality in the classical sense may not be valid on a 
manifold with singularities. However, the desired duality can be obtained in the 
framework of Connes’ noncommutative geometry [Con94]. A detailed exposition 
is given in Appendix C, and now we describe only the main ideas involved. 

To a singular Zn-manifold M , one assigns a noncommutative C* -algebra 
which should be regarded as the “function algebra” on M . Now Poincare 
duality gives a pairing 

(0.19) ( , ) : K,{Wm") X Ko{Am,.) 

where the second group is the A-group of the (7*-algebra AM,n> As a special case 
of this construction for dM = 0, one obtains the pairing (0.16), since in this case 
the algebra Am, tv coincides with the algebra of continuous functions on M and 
the A-group of the algebra of continuous functions on a space coincides with the 
A-group of the space. 

Applying the constructions (0.18) and (0.19) to the mapping (0.17), one finds 

that 

invZ) = {[cr{D)],y) € Q/nZ, 

just as in the case of a closed manifold, for some element 

y e Ko{AM,n,Q/nZ) 

depending only on the manifold. The index defect theorem for Z„-manifolds in the 
authors ’s paper [SSOl] gives an explicit formula for this element. 
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The contents of the paper are as follows. In the first section, we define spectral 
boundary value problems and prove a theorem on index decompositions. Section 2 
deals with index defects in even subspaces. In Section 3, we study index defects on 
Z^-manifolds. The paper concludes with three appendices, the first dealing with 
the Atiyah-Patodi-Singer 77 -invariant and the remaining two with Poincare duality 
in A-theory on smooth manifolds and Zn-manifolds. 



1. Spectral boundary value problems and their index 

1.1. Atiyah-Patodi-Singer spectral boundary value problems. We 

start by introducing some notation. Let M be a smooth compact manifold with 
boundary and 

D : C^{M, E) — > C^(M, F) 

an elliptic first-order differential operator on M acting in the spaces of sections of 
vector bundles E,F ^ Vect(M). 

We choose some collar neighborhood 

UdM^dMx[Q,l) 

of the boundary dM. The normal coordinate on the half-open interval [0, 1) is 
denoted by t. Then D can be represented in this neighborhood in the form 

( 1 - 1 ) 

(here stands for equality up to a vector bundle isomorphism) for a smooth 
family A{t) of elliptic first-order differential operators on dM. This representation 
can be obtained as follows. In the collar neighborhood of the boundary, we take 
some isomorphisms n*{E\gj^) ~ E\qmx[o,i) where 

7T : dM X [0, 1) ^ dM is the natural projection. Then D is isomorphic in Uom to 
an operator in the spaces 

C^(dM X ^ C°^(dM X [0,l),7r‘(F|9„)), 

where the operator d/dt is well defined, and we obtain a decomposition 

where P(t) is a vector bundle homomorphism. By ellipticity, T{t) is an isomor- 
phism, and we arrive at (1.1). 

For simplicity, we also assume that for small t the family A{t) is independent 
of t and coincides with a given self-adjoint operator 

A : C^{dM,E\eM) C^{dM,E\oM) 



on the boundary. The operator A is called the tangential operator of D. 
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Definition 1.1. The Atiyah-Patodi-Singer spectral boundary value problem 
for an elliptic operator D is the boundary value problem 

( 1 . 2 ) [Du = f, 

g e imn+(A), 

where n_j_(^) is the nonnegative spectral projection of A: 



n+(^)cA = 



0 , 



A > 0, 
A<0, 



for any eigenvector e\ of A with eigenvalue A. 



For an arbitrary elliptic operator D, the spectral boundary value problem 
defines a bounded Fredholm operator in the spaces 

(1.3) {D,U^{A)) : H\M,E) F) 0lmn+(A), 5 > 1/2, 

where ImII+(^) is the closure of the range of n_(_(A) in (see 

[APS75]). 

As usual, the index ind(D,II+(A)) of the spectral boundary value problem is 
independent of the Sobolev smoothness exponent s and can be computed in spaces 
of smooth functions. 

Note that, in contrast with the index of elliptic operators on closed manifolds, 
the index of the Atiyah-Patodi-Singer problem is not invariant under homotopies 
of D. Indeed, consider a smooth homotopy 

Dr : C^{M,E) — > r G [0,1], 

of elliptic operators, i.e. an elliptic operator family with coefficients smoothly de- 
pending on r. Suppose that an eigenvalue of the tangential operator Ar changes 
its sign at some point r — r'. Then the corresponding spectral projection expe- 
riences a jump, and consequently, the spaces in which the operator acts change 
discontinuously. This intuitive argument is stated in Theorem 1.4 below in terms 
of the spectral flow. 

1.2. The spectral flow. Consider a smooth family {Ar}^^^Q ^ of elliptic 
self-adjoint operators on a closed manifold and assume that the operators at the 
endpoints t = 0 and t = 1 are invertible. 

Definition 1.2. The spectral flow sf i] family i] 

the net number of eigenvalues of Ar that change their sign from minus to plus as 
the parameter r increases from 0 to 1 (see Fig. 2). 

Unfortunately, this definition does not makes sense for general families. The 
spectral flow of an arbitrary family {Ar} can be defined by different methods (see 
[Phi96], [Mel93], [Sal95], [BBW93], [DZ98], [NSS99], and other papers). For 
example, one can slightly deform the straight line A = 0 in the (A,r)-plane in a 
way such that the spectral curves of the operators Ar intersect the perturbed line 
transversally. Then the spectral flow can be defined as the intersection number 
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of the perturbed line with the graph of the spectrum of the family. The desired 
perturbation can be constructed explicitly as follows (e.g., see [Mel93]). 

A continuous family of elliptic self-adjoint operators has the following property. 
For an arbitrary r' G [0, 1], there exists a number that is not an eigenvalue of 
Ar in an neighborhood of r'. This follows from the fact that the spectrum of Ar 
is discrete. 

Now we choose a finite partition 
(1.4) 0 = To < Ti < ... < = 1 

of the interval [0,1] and numbers {Xi}i=o,N-i, referred to as weights, such that 
Xi is not an eigenvalue of the family Ar on the interval [ri^Ti-^i]. We also assume 
that Ao == Aat = 0. 

Definition 1.3. The spectral flow of the family is the number 

N-l 

(1-5) 

i=l 

where IIa (A) is the spectral projection of a self-adjoint operator A corresponding 
to eigenvalues greater than or equal to A and 

ind(nA(v4),n^(v4)) = sgn(^ - A)dimAA,^, 

is the relative index of two projections. Here Aa,^ is the spectral subspace of A 
corresponding to eigenvalues in the interval [min{A,/x},max{A,//}). 

One can show that the spectral flow (1.5) is well defined, i.e., is independent 
of the choice of the partition {r^} and the weights {A^}. 
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Let us now return to our original problem and consider a smooth homotopy 
Dr: ^ [0? 1]? elliptic operators on a manifold with boundary. The corresponding 

family of tangential operators will be denoted by {Ar}. We shall now give a formula 
for the difference of indices at the endpoints of the homotopy. It turns out that 
the difference is equal to the spectral flow of the family of tangential operators. 

Theorem 1.4. (The spectral flow theorem.) One has 

(1.6) ind(Do,n+(^o)) - ind(£>i, n+(Ai)) = sf{ylt}fe[o,i]. 

Remark 1.5. This result does not contradict the homotopy invariance of the 
index, since we change not only the operator D, but also the spaces where the 
index is computed. 

Proof. 1. One can readily obtain (1-6) if the family Ar is invertible for all 
r. Indeed, in this case the right-hand side of (1.6) is zero by the definition of the 
spectral flow. Let us verify that the indices on the left-hand side are equal. To 
this end, we note that the family of nonnegative spectral projections is smooth. 
Consider the Cauchy problem 

Ur= [n+ (T) , n+ (^,)] Ur, Uo = ld. 

One can readily verify that the solution Ur is a unitary elliptic operator specifying 
an isomorphism 

Ur : ImIl4_(Ao) — ^ Imn+(Ar) 

of the subspaces defined by the pseudodifferential projections 11+ (^o) and 11+ (^r)- 
The composition 

(o C/-1 yDr,U+{Ar)Y :C^{M,E)^C^{M,F)elmTl+{Ao) 

has the same index as the original problem {Dr:H-\-{Ar)). On the other hand, 
the composition acts in spaces independent of t. Thus, by the standard index 
invariance, its index does not change. 

2. Now consider the general case in which the operators of the tangential family 
Ar may be noninvert ible. To this end, we choose some partition (1.4). Using the 
argument in the previous part of the proof, on the first interval [to,ti] we obtain 

ind(Do,riAo(To)) = ind(DT-,riAo(T)), r G [ro,ri]. 

Considering this equation for t = t \ and replacing the projection IlAo(j4.ri) by 
riAi(>lTi) (they differ by a finite-dimensional projection), we obtain® 

ind(i?o,nAo(To)) = ind(£>ri,nAi(^n)) + ind(^Al(Tl),^Ao(^Tl))■ 

A similar modification of ind(Z)T-j,nAi(Tj)) at T 2 gives 

md{Do,Uxg{Ara)) = ind(£>r2,nA2(T2)) 

-t- ind(IlAi (Ti ) , IIao ( A,-J) -|- ind(nA2 {Ar ^ ) , Haj (A^J) . 



®To justify this and subsequent index computations, one uses the fact that the relative index 
ind(P, Q) of projections coincides with the index of the Fredholm operator Q : Im P ^ ImQ. 
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Proceeding similarly at the subsequent points T 3 ,T 4 ,..., we obtain the desired 
equation 

ind(L>o,n+(^o)) = md(Z?i, II+Oi)) + sf{^^}i-g[o,ij. 

□ 

1.3. A theorem on index decompositions. It follows from the spectral 
flow theorem in the previous subsection that the index of the spectral boundary 
value problem (JD,II+(A)) is uniquely determined by the principal symbol cf (D) 
and the tangential operator A. There arises a natural question: Is it possible to 
decompose the index of the spectral boundary value problem into the sum 

(1.7) ind {D, n+(A)) = /i (a (D)) + h (A 

of a homotopy invariant fi {a (D)) of the principal symbol of the operator and a 
functional /2 (A) of the tangential operator? If this representation is possible, how 
to And it? 

We shall sometimes refer to Eq. (1.7) as an “index decomposition.” 

Remark 1.6. The functional /2 is not a homotopy invariant of the tangential 
operator in general. Indeed, the set of operators with a given principal symbol ct{D) 
contains operators with arbitrary index. Thus, /2 can take infinitely many values. 
A more precise analysis shows that /2 is a homotopy invariant of the corresponding 
spectral projection. 

It turns out that there is an obstruction to the index decomposition. 

Indeed, suppose that (1.7) is valid. Consider a homotopy Dr of elliptic opera- 
tors such that the homotopy of their tangential operators Ar is periodic: Aq = A\. 
We claim that in this case the indices of the spectral boundary value problems for 
Dq and Di are equal. Indeed, 

h{a{D^)) = h{a{D,)), 
since the symbols are homotopic, and 

/2(^o) = /2(^l), 

since the tangential operators Aq and A\ coincide by assumption. 

On the other hand, by virtue of the spectral flow theorem, the difference of 
indices at the endpoints of the homotopy is equal to the spectral flow of the periodic 
family of tangential operators. Thus, we obtain the following result. 

Proposition 1.7. If the index decomposition is valid, then for an arbitrary 
homotopy of tangential operators Ar, r , one has 

( 1 . 8 ) si{Ar}res^ - 0 . 

It is well known that there exist periodic families of elliptic self-adjoint opera- 
tors with nontrivial spectral flow (1.8). (Simple examples can be found in [Sav99].) 
Therefore, the index decomposition (1.7) does not exist on the space of all elliptic 
operators. 
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Remark 1.8. A reader familiar with the theorem on the cobordism invariance 
of the index [Pal65, MP97] might expect that the spectral flow is always zero. 
Indeed, according to Atiyah-Patodi-Singer [APS76a] the spectral flow of a peri- 
odic family is equal to the index of the operator djdt At on the torus x X. 
Therefore, if AtS are tangential operators of a periodic family Dt of elliptic oper- 
ators, then by the cobordism invariance the spectral flow has to vanish. However, 
the periodicity of Dt is not assumed in the proposition. 

In other words, to achieve (1.7), one has to consider subspaces rather than the 
entire space of elliptic operators. Using this idea, one can prove a result similar 
to Proposition 1.7, where one considers only homotopies of tangential operators 
within some given class of operators. 

Namely, let E be a subspace of the space of all elliptic Hermitian symbols acting 
in the restriction of the bundle E to the boundary. In the space E11(M, U, F) of 
elliptic operators on M acting between the spaces of sections of vector bundles E 
and F, we consider the subspace Op(E) of operators such that the symbols of the 
corresponding tangential operators belong to E: 

Op(S) = jz) e E11(M, E, F) I (t{A) € e|. 

We assume that E is nondegenerate in the following sense: the natural mapping 
Op(E) ^ E taking an elliptic operator on the manifold with boundary to the 
principal symbol of its tangential operator is surjective. In other words, every 
element of E can be realized as the symbol of the tangential operator for some 
elliptic operator on M. 

Definition 1.9. The class Op(E) admits an index decomposition if there exist 
two functionals 

/i,2 • Op(E) — > IR 

such that 

(1) the first functional is a homotopy invariant of the principal symbol of the 
operator, i.e., fi{D) = fi{a{D)); 

(2) the second functional is determined by the tangential operator, i.e., 
h{D) = h{A); 

(3) for D G Op(E), one has 

ind(D,n+(A))=/i(^(D)) + / 2 (A). 

We shall state a necessary and sufficient condition for the existence of a de- 
composition (1.7) in terms of the following condition on the class E of symbols. 

Definition 1.10. The class Op(E) is said to be admissible if for an arbitrary 
periodic family {At-}t-^§i of elliptic self-adjoint operators on dM one has 

sf{AT-}T-^gi = 0 

provided that a{Ar) G E for all r. 
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Theorem 1.11. (The index decomposition theorem.) The class Op(Xl) admits 
an index decomposition if and only if it is admissible. 

Proof. Necessity can be proved by analogy with Proposition 1.7. The proof 
of sufficiency can be found in [SSS99a]. □ 

The admissibility condition can be verified effectively. Indeed, the principal 
symbol of an elliptic self-adjoint operator ^ on a manifold X (in our case, X = dM) 
defines an element 

[a{A)] - [Imn+cr(T)] G K\S*X) 

in the i^-group, where Imn+cr(T) G Vect(5*X) is the subbundle generated by 
the positive spectral subspaces of the principal symbol cr{A) on the cosphere bun- 
dle S*X (with respect to some Riemannian metric). Then the spectral flow of a 
periodic family A = of elliptic self-adjoint operators can be computed by 

the Atiyah-Patodi-Singer formula [APS 76a] 

(1.9) sf { = (ch [cr{A)] U Td (T* A (g) C) , [S^X x ) . 

Here ch [o-(A)| G [S*X x S^) is the Chern character of the element 

[a{A)] = [Imn+fj(A)] G {S*X x S^) 

defined by the principal symbol of the family, Td is the Todd class, and {, ) is the 
pairing between homology and cohomology. 

Remark 1.12. The obstruction to the index decomposition given in Theorem 
1.11 has the following cohomological interpretation. Note that the spectral flow of a 
periodic family of tangential operators with symbols in E defines a homomorphism 

sf : 7 Ti(E) — > Z, 

^ (ch [a{A)] U Td (T*X ® C) , x S^] ) , 

of the fundamental group into integers. It vanishes on commutators. Therefore, 
by the well-known isomorphism Hi{X) — 7Ti(A)/[7ri(A), 7 Ti(A)], the spectral flow 
defines a cohomology class 

Now the admissibility condition is equivalent to the vanishing of this cohomology 
class. 

Theorem 1.11 shows that if the integral (1.9) is zero for an arbitrary periodic 
homotopy in some class E, then the corresponding class of spectral boundary value 
problems is admissible and the index admits a decomposition. 

Now consider examples in which this condition is satisfied. 
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1.4. Examples. 

1. Even subspaces. Consider the antipodal involution 

a : S^dM — > S^dM, a (x, 0 = (x, 

of the cosphere bundle of the boundary dM. For a vector bundle E E Vect(M), 
we consider elliptic Hermitian symbols 

a : 7T*E\dM — ^ 7T*E\dM: 7T : S^dM dM, 

invariant under the involution 

(1.10) a(a;,-0 = a(*,0- 

In this case, the contributions to (1.9) from antipodal points in the integral 
over the cosphere S*dM corresponding to any x E dM cancel provided that dM 
is odd-dimensional. Here we have used the fact that a preserves (or reverses) 
the orientation of S*dM depending on the parity of the dimension of dM. Thus, 
Eq. (1.8) is satisfied in the case of an even- dimensional manifold M for operators 
whose tangential operators have even principal symbols (see Eq. (1.10)), and the 
index decomposition for the corresponding spectral boundary value problems is 
possible. In the following section, we obtain the index defect formula for this case. 

2. Odd subspaces. For an odd- dimensional manifold M, the antipodal in- 
volution a preserves the orientation of S*dM. In this case, one should consider 
odd symbols a antiinvariant under a: 

a{x,-0 = -a{x,0- 

A computation shows that the contributions of antipodal points to (1.9) cancel 
modulo a form lifted from the base of the cosphere bundle. Therefore, the integral 
is zero, and this class of boundary value problems has an index decomposition. This 
“odd” case is largely analogous to the even case. Some new phenomena appear in 
this case. We touch on this theory only briefiy at the end of Subsection 2.2. For a 
detailed exposition, we refer the reader to [SSOO]. 

3. Manifolds whose boundary is a covering. Suppose that the boundary 
is a smooth n-sheeted covering 

iridM — ^ A. 

We consider the class of operators adapted to this structure in the sense that their 
tangential operators are lifted from the base of the covering. The lift is defined by 
the local diffeomorphism tt. 

Let us compute the spectral fiow of a periodic family of tangential operators 
By assumption, this family is the lift of some family of elliptic 

self-adjoint operators from the base X. Since formula (1.9) is local, we obtain 

sf{A^}^esi =nsf{A^}^^si E nZ. 

This is zero as a residue modulo n. Therefore, the assumption of Theorem 1.11 is 
satisfied modulo n, and the index of the corresponding boundary value problems 
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as a residue modulo n admits the desired decomposition.^ The index defect in this 
situation will be studied in Section 3. 



2. Index defects for problems with parity conditions 

In this section, we describe index defects for spectral boundary value prob- 
lems in even subspaces (see Example 0.2 in the introduction). The methods of 
X-theory of operator algebras are very effective in this case. In the framework of 
this approach, the index defect appears naturally as a dimension type functional 
of subspaces determined by spectral projections. 

In this section, we first define a dimension-type functional of subspaces and 
then prove the defect formula. 



2.1. The dimension functional for even subspaces. 

Definition 2.1. A pseudodifferential operator 

P :C^ {X,E) C^{X,E) 

is said to be even if its principal symbol cr{P) is invariant under the antipodal 
involution: 



(2.1) (7{P) = a*a{P), a:S*X-^S*X, a = {x, . 

Proposition 2.2. Let A be an even- order elliptic self-adjoint differential op- 
erator. Then the spectral projection II_i_(A) is even. 



Proof. The principal symbol of a differential operator of order n has the 
property 



21^1 

(for an invertible A), we see that the principal symbol of 11+ (A) is given by 

a(n+(+) = n+(a(^)), 



Since 



a* a (A) = ( 



TT r A\ 



where 11+ (a (A)) is the orthogonal projection on the nonnegative spectral bundle 
of the symbol cr(A). (Here we use the following result due to Seeley [See67]: 
the principal symbol of a function of a self-adjoint operator is equal to the same 
function of the symbol.) 

The IcLst formula gives the desired equality 



^(n+ {A))=a*a{n+ (A)) 



for even-order operators. 



□ 



^We use a theorem similar to Theorem 1.11, where one considers the index modulo n and 
the spectral flow modulo n; this result can be proved by the same method. 
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We say that two even projections P\ and P 2 are isomorphic, if there is an 
isomorphism of the corresponding ambient vector bundles (possibly after adding 
zero projections in some bundles to Pi and P 2 ) interchanging the projections. Two 
projections in the sections of the same bundle are homotopic, if there is a homotopy 
joining them. The Abelian semigroup of even pseudodifferential projections on X 
modulo homotopy and isomorphism is denoted by Even (A). The corresponding 
Grothendieck group ^ will be denoted by K (Even (A)). Let us give an alternative 
description of this group. 

Consider the algebra "^ey{X) of scalar even pseudodifferential operators of 
order zero. The Grothendieck group of the semigroup of homotopy clcisses of pro- 
jections in matrix algebras over is denoted by Ao(^ev(A')) and called the 

even K-group of the algebra "^ey(X) (e.g., see [Bla98]). 

Lemma 2.3. One has 

Ko{^ev{X))c,K{^{X)). 

Proof. The proof is immediate from the definitions of the Grothendieck 
group K (Even (A)) and the A-group of an algebra. Both are Grothendieck groups 
of Abelian semigroups generated by homotopy classes of even pseudodifferential 
projections. □ 

Let us compute the A-group of ^ev(Ar). 

Theorem 2.4. If X is odd- dimensional, then there is an isomorphism 

(2.2) (Z©iC(X))®Z i \ ■ 

Here the mapping takes an integer k E It to a projection of rank k and a vector 
bundle E G Vect(A) to a projection defining E as a subbundle of some trivial 
bundle. By Z[l/2] we denote the ring of dyadic rationals. 

Proof. 1. Let ^e^(A) be the C*-algebra obtained as closure of ^e^(A) in 
the L^-norm. The closure does not change the A-group: 

Ao(^e.(X))~ Ao(^e.(^)). 

2. The algebra ^ev(A) contains the ideal JC of compact operators, and one 
has the exact sequence of algebras 

(2.3) O^JC — > ^ev{X) C{P^X) — > 0. 

Here the projection takes each operator to its principal symbol. We also treat even 
symbols as continuous functions on the projectivization P*A = 5*A/Z2 of the 
cosphere bundle. The sequence is well defined by virtue of the well-known norm 
estimates 

M\\D + K\\l^x)^l^x) = sup |o-(D)(a;,OI- 

^Recall that the Grothendieck group S of an Abelian semigroup S is generated by formal 
differences [a] — [6], a, 6 G 5 modulo the relation [a + c] — [6 + c] = [a] — [6]. 
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Furthermore, the sequence (2.3) induces the long exact sequence 

^ K,{C{P*X)) ^ Ko(fC) Koi^eviX)) Ko{C{P*X)) ^ Ki{X) ^ 

of K-groups, which is in our case reduced to 

(2.4) K\P*X) M Z — > Ko(^ev{X)) K{P*X) -> 0. 

Here we have substituted the well-known equalities K^iJC) — Z and Ki{KL) = 0 
and replaced the K-groups of the function algebra C{P*X) by the topological 
K -groups of P*X. 

Let us describe the mappings in (2.4). The first mapping takes an elliptic even 
symbol to the index of the corresponding operator. The second mapping takes a 
positive integer A: to a projection of rank k. (Such a projection is even, since its 
symbol is zero.) Finally, the mapping smbl takes a pseudodifferential projection 
P to the range Ima(P) G Vect(P*X) of its principal symbol treated as a vector 
bundle over P*X. 

For the existence of a functional d making the diagram 



(2.5) 



Ko{IC) = 



Koi^eviX)) 




commute, it is necessary that the vertical arrow be a monomorphism or, equiv- 
alently, the index mapping in (2.4) be zero. This condition is satisfied if X is 
odd-dimensional. Indeed, it is well known (e.g., see [Pal65]) that the index of 
operators with even principal symbol is zero on such manifolds. Therefore, the 
sequence can finally be rewritten as 

(2.6) 0 ^ Z ^ Koi^eviX)) K{P^X) 0. 

3. Let us slightly simplify this sequence further. To this end, we note that the 
natural projection p : P*X ^ X for an odd-dimensional X induces an isomor- 
phism in X-theory modulo 2-torsion. More precisely, the following is valid. 



Proposition 2.5. [Gil89b] The projection P*X X induces an isomor- 
phism 



p* : K* {X) (8) Z 



1 

2 



X* (P*X)(g)Z 



r 

2 ■ 



Sketch of Proof. One first verifies the statement over a point x e X: here 
= 0 and = Z 2 n, which shows that 



p* :K* {{x})^Z 



1 

2 



K* (p;x)0z 



1 

2 



is an isomorphism. Now the isomorphism for the entire space can be proved by 
the Mayer-Vietoris principle ([BT82]). □ 
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Taking a tensor product of the sequence (2.6) by the ring of dyadic rationals 
(which does not violate the exactness), we obtain the exact sequence 

O^Z i ^ Koi^ev{X))®Z i ^K(X)®Z ^ ^ 0. 

4. This exact sequence has a splitting mapping 

K°{X)®Z \ ^ K{E^{X))^Z i 

z z 

taking a vector bundle to a projection on the space of its sections in C°^{X,C^) 
for sufficiently large N, 

5. The splitting obviously gives the desired isomorphism (2.2). □ 

The first component of the isomorphism (2.2) will be called the dimension 
functional for even pseudodifferential projections. It is useful to restate Theo- 
rem 2.4 in the following way. 

Theorem 2.6. [SS99] (A theorem on the dimension functional.) On an odd- 
dimensional manifold X , there exists a unique group homomorphism 

d:K{F^{X)) — 

with the property 

(2.7) d(F)=rankP 

for a finite rank projection P under the normalization 

d(PF)=0, 

for all projections Pp : C^(X^E) — )■ C^(X,E) on the space of sections of a sub- 
bundle E C E. Moreover, for an arbitrary even projection P and for a sufficiently 
large N the projection 2^ P is homotopic to the direct sum of a projection on the 
space of sections of a subbundle and a finite rank projection. 

2.2. The index defect formula. Let us apply the dimension functional d 
of even projections to the theory of spectral boundary value problems. 

1. The dimension d as an index defect. We shall consider elliptic operators 
D with even tangential operator A. In this case, the spectral projection 11+ (A) is 
even as well (see Proposition 2.2). 

Remark 2.7. Clearly, this condition cannot be satisfied for first-order dif- 
ferential operators. Thus, in this subsection we consider the more general class of 
operators that are pseudodifferential far from the boundary and have the form (1.1) 
with a first-order pseudodifferential operator A on dM near the boundary. For this 
class of operators, the spectral boundary value problems are also well defined and 
have the Fredholm property. Such differential operators with respect to the normal 
variable were considered in detail in [H6r85], Chapter 20. 
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Lemma 2.8. The sum 

ind(D,n+(A)) + d(n+(A)) 

is a homotopy invariant of the operator D. 

Proof. Consider a homotopy Dr,r e [0, 1], and the corresponding homotopy 
Ar of tangential operators. By the homotopy invariance of the dimension functional 
and property (2.7), it follows that the variation of the dimension is equal to the 
spectral flow 

d{U^{Ai)) - d(n+(^o)) = si{Ar}re[o^y 

(The equality can be obtained by analogy with the proof of the theorem on the 
spectral flow with the use of a partition of the interval [0, 1] and some choice of 
weights on the intervals of the partition.) A similar formula holds for the variation 
of the index: 

ind(jDi, n_|_(Ai)) — ind(Do 5 n_^ (Aq)) = — sf{AT-}T-^[o,i]. 

Combining the two expressions, we obtain the desired homotopy invariance of the 
sum indicated in the lemma. □ 

This homotopy invariant will be denoted by 

mvD ind(L>, n+(A)) + d{U^{A)). 

Let us give a topological formula for this analytic invariant. This can be done by 
generalizing the Atiyah-Singer topological index to the case of spectral boundary 
value problems in even subspaces. 

2. The topological index. It turns out that the principal symbol cr{D) has 
a natural extension to the double 

2M-M[ 1 M 

^dM 

of the manifold M. The double is obtained by gluing two copies of M along the 
common boundary. 

To construct the desired extension, we take the symbol cr{D) on the first copy 
of M and the symbol a*(j {D) on the second copy. Here 

a : 5*M 5*M 

is the antipodal involution. Then in a neighborhood of the boundary the symbols 
cr{D) and a*(j{D) have the form 

ir-\-a{x,^) and — zr + a(x,^), 

respectively. They are taken into one another by the coordinate transformation 

X ^ X, t ^ —t 

in a neighborhood of the boundary. Therefore, taken together, they define an 
elliptic symbol a{D) U a*a{D) on the double of M. The difference element of this 
symbol will be denoted by 

[a{D)[Ja*a{D)] e Kc{T*2M). 
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Then the topological index of D is defined as half the Atiyah-Singer topological 
index of this element on the double: 

indt[cr(£))] ^ indt[<r(£)) U a*a{D)]. 

3. The index defect formula. 

Theorem 2.9. [SS99] Let D be an elliptic operator on an even- dimensional 
manifold with even tangential operator A. Then 

(2.8) invJ9 = indt[cr{D)]. 

Proof. We know that both sides of the formula are determined by the prin- 
cipal symbol of the operator. Thus, to prove the equality it suffices to simplify 
the principal symbol by a homotopy and then check the equality for the simplified 
symbol. 

For sufficiently large N, Theorem 2.6 in the previous subsection gives a ho- 
motopy 7T^, r G [0, 1], of the direct sum of 2^ copies of the symbol o-(n+(A)) to 
a projection on some subbundle Eq C 2^E\om- One can lift this homotopy of 
projections to a homotopy cr{D^) of elliptic symbols with the properties 

a{Do) = 2^a{D), <r(n+(A,)) = ^r- 

By the homotopy invariance of both sides of Eq. (2.8), it suffices to prove the 
equality only for the symbol cr{Di) obtained at the end of the homotopy. This 
symbol in a neighborhood of the boundary depends only on the absolute value of 
the covector Thus, one can consider an elliptic operator Di with this symbol 
and the corresponding spectral boundary value problem such that the 

spectral projection 11+ is actually a projection on the space of sections of the 
subbundle Eq. The spectral boundary value problem in this case is a classical 
boundary value problem; the index defect (i.e. the dimension functional) is zero, 
and Eq. (2.8) follows from the Atiyah-Bott formula. □ 

Remark 2.10. (On the dimension functional of odd subspaces.) A similar 
functional was constructed in [SSOO] on the space of “odd projections” with prin- 
cipal symbols satisfying 

aV(P) = 1 - a{P). 

Such projections arise as spectral projections of odd-order differential operators 
(cf. Proposition 2.2). However, the methods of AT-theory cannot be applied directly 
to odd projections, since odd symbols do not form an algebra. Moreover, the 
geometry of odd projections differs from the geometry of even ones: for example, 
an odd projection on a manifold of dimension 2k can act only in the space of 
sections of a vector bundle whose dimension is a multiple of 2^~^ (see [SSOO]). 
In the cited paper, we constructed a dimension functional and proved the defect 
formula. Let us only mention that the topological index in the odd case can be 
obtained if on the double 2M one considers the symbol cr{D) U o:*<j(jD)“^. 
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Remark 2.11, One can show [SSS99b] that the value d{U^{A)) of the di- 
mension functional and the element [cr{D) U a*a{D)] form a complete system of 
stable homotopy invariants of the spectral boundary value problem (D,II+(^)), 
i.e., classify these problems modulo stable homotopy. 

2.3. The dimension functional and the 77 -invariant. The dimension 
functional for even pseudodifferential projections was constructed in Theorem 2.6. 
More precisely, the theorem claims the existence of the functional. In this subsec- 
tion, we address the question of an explicit analytic expression for this functional. 
It turns out that such a description can be given in terms of the spectral Atiyah- 
Patodi-Singer 77 -invariant. The reader can find some details about the 77 -invariant 
in Appendix A. 

Gilkey [Gil89a] noted that the 77 -invariant is rigid within the class of differ- 
ential operators satisfying the parity condition 

(2.9) ordA + dimX = l(mod2), 

which relates the order of the operator to the dimension of the manifold. Rigidity 
is understood in the sense that the fractional part of the 77 -invariant is not only 
spectrally invariant but also homotopy invariant. 

Condition (2.9) coincides with the conditions under which there exists a func- 
tional d of the corresponding spectral projections. (Recall that in the previous 
subsections this functional was considered for even projections on odd-dimensional 
manifolds and odd projections on even-dimensional manifolds.) This is not a mere 
coincidence. In fact, the 77 -invariant of an arbitrary elliptic self-adjoint operator 
A coincides with the value of the dimension functional on the spectral projection 

n+(>4). 

Theorem 2.12. [SS99, SSOO] If an elliptic self-adjoint differential operator 
satisfies the parity condition (2.9), then 

rj{A) = d{U+{A)). 

Proof. For simplicity, we consider only opperators of even order 21. 

1. It was shown in Theorem 2.6 that the dimension d of even projections can 
be defined as the unique homomorphism 

d: a:(e^(x)) — 

with the following two properties: (a) d (P) — rankP for a finite rank projection 
P, (b) ^(Pf) = 0 for projections on the spaces of sections of vector bundles 
F G Vect(A). Therefore, to prove the theorem it suffices to show that the 77 - 
invariant defines a similar homomorphism and enjoys the same properties. 

2. Thus, we should consider the 77 - invariant for general even pseudodifferential 
operators. Unfortunately, the rigidity of the 77 -invariant is lost in this class, since 
lower-order terms of the operator contribute to the 77 -invariant. However, the in- 
variance still holds (see Appendix A) in the class of R^-invariant operators, i.e.. 
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operators with complete symbol having an asymptotic expansion 

smbU ~ a2i{x, + a2i-\{x, + a2i-2{x,0 + • • • > 

where each homogeneous term ak(x,^) of order k has the following parity with 
respect to the momentum variables 

ak{x,-^) = (~l)'‘ak{x,^). 

For -invariant elliptic self-adjoint operators, the spectral projection 11 -^ (A) is 
either even or odd according to the parity of the order of the operator. It is easy to 
see that the dimension functional is also uniquely characterized by (a) and (b) also 
on the space of -invariant projections (technically, this is a consequence of the 
isomorphism Ko(^et;(-^)) = where is the algebra of E+-invariant 

operators). 

3 . We claim that the r/-invariant defines a homomorphism; 

rj : K{E^{X)) — > E 

P 1-^ ^(A), 

which takes a class represented by an E* -invariant projection to the rf invariant of 
an E*-invariant elliptic self-adjoint operator A of positive order such that II_|_(A) == 
P. To prove that this homomorphism is well defined we show ( 1 ) 77(A) is determined 
by the projection P and (2) 77(A) is invariant under the equivalence relations 
defining K(Even(X)). 

To prove 77 is a well-defined invariant of the projection, we first note that 
two such operators A of the same order are linearly homotopic. Thus, their 77- 
invariants are equal by virtue of the rigidity property of the 77-invariant proved in 
Appendix A. Finally, the order of A is not essential, since 77(A) = t7(A^^+^). To 
prove that 77 extends to the homomorphism of the A-group, it suffices to show 
that it is homotopy invariant (this also follows from rigidity) and it takes a zero 
projection to zero. This last fact is indeed true, since for an invertible Laplacian 
A the 77-invariant is equal to the ^-invariant 

7? (-Y) = -c(Y), imn+ (-Y) = {0} c (x,e) . 

But the ^-invariant of the differential operator A is zero in odd dimensions (see 
the remark following Theorem 4.7 in Appendix A). 

4 . Let us now verify property (a) for the 77-invariant. For a nonnegative Lapla- 
cian A with /c-dimensional kernel, we obtain 

dimlmn+ (-A) = k, ??(-A) = k - ( (A) . 

This proves property (a): 

77(-A) = dimImn+(-A) -d(n+(-A)). 

Similarly, one obtains (b): 

77 (A) = 0 , Imn+(A) = C-(A,A). 
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By the characterization of the dimension functional, this proves that the 77 - invariant 
of an operator A coincides with the dimension d of the corresponding spectral pro- 
jection. □ 



3. Index defects on twisted Z^- manifolds 

In this section, we consider another geometric situation in which index defects 
naturally arise. This situation comes from elliptic theory on manifolds with singu- 
larities. More precisely, we consider so-called twisted Z^-manifolds. Such manifolds 
look like a book with n sheets near the singularity; the singular set is the edge 
where the sheets meet. 

The index theorem was stated and proved by Freed and Melrose [FM92] for 
the special case in which a neighborhood of the singular set consists of n sheets 
globally. Note that in this case it is natural to view the index as a residue modulo 
n, and the index theorem computes this index- residue. 

We consider general twisted Zn-manifolds. In this case, the index-residue is 
no longer a homotopy invariant and an index defect arises. Intuitively, the proof 
of the index defect formula follows the scheme explained in Subsection , so here 
we give only the main steps of the proof. We first define a special element in the 
X-theory of a Z^-manifold in Subsection 3.4. Then the topological index is defined 
as the pairing with this element. The last subsection contains an application of 
the defect formula. 

3.1. Twisted Zn-manifolds and elliptic operators. 

1. Twisted Zn-manifolds 

Definition 3.1. A twisted Zn-manifold, where n is a positive integer, is a 
smooth compact manifold M with boundary dM equipped with the structure of 
the total space of an n-sheeted covering 

(3.1) 7r:dM — ^ X 
over a smooth base X (see Fig. 3). 

Geometrically, a twisted Zn-manifold (M, tt) naturally defines the singular 
space 

W = M/ 

obtained by the identification of points in each fiber of the covering (see Fig. 1); 
the corresponding equivalence relation is defined as 

(3.2) X ^ y X = y or {x, y G dM and 7t{x) = '^{y)}- 

Sullivan [SulTO] introduced the notion of a Zn-manifold. These manifolds 
correspond to the structure of a trivial covering tt. One of the motivations showing 
the interest in such manifolds is that (in the orientable case) the manifold M has 
a fundamental class in homology with coefficients in Zn‘. 

[M"] 



m = dim M. 




INDEX DEFECTS IN THE THEORY OF SPECTRAL PROBLEMS 



199 




These manifolds with singularities were also used to give a geometric realization 
of bordism theory with coefficients in the group Further developments in this 
direction can be found, e.g., in [Bot92], 

For brevity, we frequently omit the word “twisted” in what follows. 

We point out that while most technical constructions of the theory deal with 
the smooth model (M, tt), the most important results, e.g., the defect formula in 
Subsection 3.5, are stated in terms of the singular space M itself. 

2. Natural mappings associated with coverings. Let us recall some nat- 
ural mappings induced by the covering (3.1). First, one has the direct image map- 
ping 

TT, : Vect {dM) — ^ Vect {X) 

taking a vector bundle E G Vect {dM) to the bundle ttiL’ G Vect (X) with fiber 

{7TiE)^=C^ {7t-^{x),E), xex 

— the space of functions on the fiber tt~^{x). This is indeed a vector bundle as can 
be seen either noting that E) is a finitely generated projective module over 

or computing explicitly the transition functions of mE, The transition 
functions on the intersection of two small trivializing sets in X are block-diagonal 
matrices with entries given by the transition functions of the restrictions of E to 
the leaves of the covering. 

This definition leads to a natural isomorphism 

(3e : {dM, E) ^ (X, ttiE) 

of section spaces on the total space and the base of the covering. For example, scalar 
functions on the total space correspond to sections of the bundle ttiI G Vect(X) 
on the base. (Here 1 stands for the trivial line bundle.) 
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This isomorphism enables one to transfer operators acting on dM to X and 
vice versa. More precisely, for an operator 

P : {dM, E) {dM, E) 

on dM, by ttiP we denote its direct image given by the formula 

7r,P = (3ePI3e^ ■■ {X,mE) — > C°° {X,ir,E) . 

One also has the inverse image 

(3.3) tt’P' = f3~^P'pE : {dM, E) {dM, E) 

of operators P' on X. 

On twisted Zn-manifolds, we consider the following class of operators adapted 
to the structure of the singularity. 

3. The class of operators. For a pair (M, tt), we consider elliptic differential 
operators 

D : {M,E) — > {M,F) , 

which in a neighborhood of the boundary are lifted from the base of the covering. 
More precisely, we suppose that they satisfy the following assumption. 

Assumption 1, The restrictions of E and F to the boundary are lifted from 
the base: 



E\g^ ~ tt*Eo, ~ n*Eo, Eo, Fq € Vect (X ) ; 

moreover, the corresponding isomorphisms are given. For some operator 

Do :C°°{Xx [0, 1) , Eo) {X x [0, 1) , Fo) 

on the cylinder with base X, the direct image (tt x 1), P in a neighborhood of the 
boundary can be inserted in the commutative diagram 

(3.4) {X X [0, 1) , (tt X {X x [0, 1) , (tt x 1),F) 

Do0l7r,l ' 

(Xx [0,l),Po(8)7ril) (X X [0,l),Po(^7r,l). 

Here we suppose that we have chosen a diffeomorphism 

(3.5) UoM^ [0,1) xdM 

of a collar neighborhood of the boundary and extended the projection tt to it as 
7T X 1 . Then Dq <S) Itt, i is the operator Dq with coefficients in the flat bundle tti 1 
(e.g., see [APS76a]). 

Recall that a bundle is called flat if it is defined in terms of locally constant 
transition functions (for equivalent definitions and constructions of flat bundles 
see the above cited paper or [Gil95]). 
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We also assume for simplicity that the operator Dq in a neighborhood of the 
base of the cylinder X x [0, 1) has the form (1.1), i.e., 

^o|xx[0,e) “ ^ , 

where P is some vector bundle isomorphism and the tangential operator Aq is a 
first-order elliptic self-adjoint operator on X, 

It follows from this assumption that in a neighborhood of the boundary the 
operator D has the form 

d 

— -h 7T (^0 ^ Ittii) 

(up to a vector bundle isomorphism); i.e., the tangential operator A is equal to 
TT- {Ao (g) 

We note that the classical operators always satisfy Assumption 1 in an ap- 
propriate geometric setting. For example, the Hirzebruch operator on an oriented 
even-dimensional Riemannian manifold M satisfies the assumption if (1) in a col- 
lar neighborhood of the boundary we take a metric pulled back from the cylinder 
X X [0, 1]; (2) the covering tt : dM X is oriented. Similar statements hold also 
for the Dirac and Todd operators; we leave them to the reader. 

4. The difference element. Assumption 1 is closely related to the above- 
discussed manifolds with singularities. Indeed, note that the total space T*M of 
the cotangent bundle is a (noncompact) Z^-manifold. It follows that the principal 
symbol of an elliptic operator D defines a difference element 

[a{D)]eK,{T^") 

in the X-group, since the commutative diagram (3.4) shows that the restriction 
of cr{D) to the boundary is isomorphic to a symbol lifted from the base of the 
covering T*M\qm ~^T*X x M. 

3.2. The Freed— Melrose index theorem modulo n. This subsection 
deals with the index theory on Z„-manifolds corresponding to trivial coverings 
7t; i.e., the boundary of the corresponding smooth manifold M is a disjoint union 
of n copies of the base of the covering. 

1. The index modulo n. It turns out that in this case operators satisfying 
Assumption 1 have a nontrivial homotopy invariant. Namely, let 

mod n- ind D e 

be the index of the spectral boundary value problem (D,II+(A)) treated as a 
residue modulo n. 

Proposition 3.2. The index-residue mod n- ind D is a homotopy invariant of 
the operator D. 

Proof. Consider a homotopy By the spectral flow theorem, 

ind(Z)i,n+(yli)) -ind(Do,n+(.4o)) = -sf{A(}(g[o,i]. 
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On the other hand, by assumption, the family At of tangential operators is the 
direct sum of n copies of the family {Ao,^} of tangential operators on X. Therefore, 

sf{^t}tG[o,i] = ?^sf{Ao,i}tG[o,i] =0(modn). 

This shows that the spectral flow vanishes as a residue modulo n and proves the 
homotopy invariance of the index- residue. □ 

This homotopy invariant index residue was computed in terms of the principal 
symbol by Freed and Melrose. In Subsection 3.5, we obtain a more general formula, 
and now we briefly recall the Preed-Melrose formula, just to make the exposition 
complete. 

2. The Preed-Melrose theorem. Consider the category of Z^-manifolds 
with morphisms given by embeddings that take the boundary to the boundary and 
the flbers of the coverings to the flbers. The direct image mapping in X-theory 
extends to this category. More precisely, for an embedding / of a pair (M, tt) in 
{N,7Tn) there is a direct image mapping 

/, : K,{Wm") K,{Wn"^). 

On the other hand, there is a universal space in which one can embed an arbitrary 
Z^-manifold corresponding to a trivial covering. The universal space can be defined 
as follows. From we cut away the union of n disjoint discs. We denote the 
resulting manifold with boundary by M^. It can be viewed as a Z^-manifold, since 
its boundary consists of n diffeomorphic spheres. (The diffeomorphisms are given 
by translations.) One can readily compute the K-group of the cotangent bundle 
of this space: 

Kc{T^"') -Zn. 

Freed and Melrose proved the following index theorem. 

Theorem 3.3. [FM92] One has 

modn-indD = f\ [a (D )] , 

where the direct image 

/, : k,{Wm") K,(WaC') - z„ 

is induced by an embedding 

The proof models the K-theoretic proof of the Atiyah-Singer index theorem 
based on embeddings. The cornerstone of the proof is the statement that the 
analytic index is preserved under the direct image mapping, that is, the diagram 

/! 






Kc{T*N'"') 
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commutes for an embedding f oi M in N. 



3.3. The index defect problem on twisted Z^-manifolds. In contrast 
to the case of Z„-manifolds corresponding to trivial coverings, considered in the 
previous subsection, the index modulo n is no longer a homotopy invariant if the 
covering is nontrivial By way of illustration, consider the following simple example. 

On the cylinder x [Ti, T 2 ] with coordinates ((/?, t), consider the scalar elliptic 
operator 



Clearly, the tangential operator is lifted from the base of any of the coverings 



TTn : s ^ ^ t— > n(p. 

On the other hand, if T\ or T 2 passes through zero, then the index of the corre- 
sponding spectral boundary value problem jumps by 1 and is not constant as a 
residue modulo n for any n ^ 1. 

1. The index defect. The example shows that the index-residue is not ho- 
motopy invariant and cannot be computed topologically. The following theorem 
gives the index defect in this situation. 

Theorem 3.4. [SSOl] On a twisted Zn-manifold, the difference 
rj (A) — nr] {Aq) e R/nZ 

is an index defect. Here n is the number of sheets of the covering^ and rj{A) 
and r] {Aq) are the spectral Atiyah-Patodi-Singer rj-invariants of the tangential 
operators A and Aq, respectively. In other words, the sum 

(3.6) mod n-ind {D, 11+ (A)) -h rj {A) — nrj {Aq) e M/nZ, 
is a homotopy invariant of D. 

Proof. Consider a homotopy Dt of operators. The corresponding homotopy 
of tangential operators will be denoted by At and the homotopy of operators on 
the base X by 

As t varies, the index ind(T)t, Il+(At)) can jump. The geometric Atiyah- 
Patodi-Singer index formula (see Appendix A) shows that the sum 

ind{DuU^{At))Ar]{At) 

is a smooth function of the parameter. Furthermore, the derivative of the sum 
with respect to f is a local invariant; namely, it is equal to the integral over the 
manifold of an expression determined by the complete symbol of the family At 
of tangential operators. On the other hand, the complete symbols of At and Ao,t 
locally coincide by Assumption 1. Therefore, the jumps in the sum 

(3.7) ind {Dt, II+(+)) + rj {AQ - nr] {Aq^Q 

of three terms come only from the third term. These jumps, however, are multiples 
of n. Hence, reducing (3.7) modulo n, we obtain a quantity independent of t. This 
proves the theorem. □ 
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2. A relation to known invariants. We denote the homotopy invariant 
constructed in the theorem by 

invD modn-ind {D, 11+ (A)) + r] {A) — nrj (Aq) G M/nZ. 

In some special cases, it can be reduced to the following invariants. 

(1) For a trivial covering, we have an isomorphism 

A~Ao0Ao0...0Ao . 

n copies 

Hence rj{A) = nrj{AQ), and invD is thereby reduced to the Freed-Melrose 
modn-index [FM92] 

modn-ind(Z), n+) G Z^ C R/nZ. 

(2) On the other hand, if we consider only the fractional part { } of (3.6), 
then the index vanishes and we obtain the Atiyah-Patodi-Singer relative 
r) -invariant [APS76b, APS76a] 

{V {Ao ® U,i) - nri {Ao)} € R/Z 

of the operator Aq with coefficients in the flat bundle ttiI C Vect (A) . 

3. The invariant invD as an obstruction. Let us give an interpretation of 
the invariant inv as an obstruction. 

Suppose that the manifold M itself is the total space of a covering n over some 
base Y and the induced covering at the boundary coincides with tt: 



dM c 


M 


TT i 


i ^ 


X C 


Y. 


Proposition 3,5. If an operator 




(3.8) D:C^{M,E)~ 


(M, F) 



satisfying Assumption 1 is the lift of some operator Dq from Y, then 

mvD = 0. 

Proof. By the Atiyah-Patodi-Singer formula, the sum 
md{D,U+{A)) + r,{A) 

can be expressed as the integral over the manifold of an expression depending on 
the complete symbol of D. On the other hand, the operators D and Dq on the 
total space and on the base locally coincide. Thus, we obtain 

ind {D, n+(A)) +r,{A)=n (ind (£»o, n+(^o)) + V (Aq)) . 

Transposing the term nrj (Ag) to the left-hand side, we obtain invD = 0. □ 
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Remark 3.6. We point out that an arbitrary operator D is not induced by 
some elliptic operator Dq on the base in general. Proposition 3.5 gives a necessary 
condition for the existence of such operators: if Dq exists, then irrvD is zero. 

The principal symbol of D defines an element in the K-group of the space 
. To associate some topological index with this element, in the following 
subsection we use Poincare duality on manifolds with singularities of the above- 
described type. For the reader’s convenience, the survey contains Appendices B 
and C, where we discuss Poincare duality on smooth manifolds and on singular 
Zn-manifolds. 

3.4. The element of AT-theory defined by a manifold whose boundary 
is a covering. In this subsection, we show that a pair (M, tt) consisting of a 
compact manifold M and a covering tt : dM X defines a special element in the 
A"-group 

Xo{AM,7T,Q/'nZ) 

with coefficients in the group Q/nZ. Here Am, 7 t is the C^-algebra of the twisted 
Zn -manifold. This algebra is defined in Appendix C. To define our element, we 
first need a geometric description of elements of the /T-group. The coefficient 
group Q/nZ looks slightly complicated, and hence we first consider a geometric 
realization of the AT-groups with finite coefficient group Z„. After this, we return 
to the complicated coefficients. 

1. AT-theory with coefficients Z^. There are several equivalent approaches 
to the definition of these A"-groups (e.g., see [Bla98]). We use the definition coming 
from topological A"-theory. Namely, the group Z^ has the corresponding Moore 
space. It is the 2-dimensional complex Mn obtained from the unit disk by the 
identification of points on its boundary under the natural action of the group Z„: 

M„= {zeC \ 1^1 < 

In particular, for n — 2 this space is the real projective plane M 2 — MP^. 

The A"-group with coefficients Z^ for an algebra A can be defined as 

(3.9) Ko {A, Zn) = K^ (Co (M, , ^) ) , 

where Co {M^A) is the algebra of valued continuous functions on the Moore 
space vanishing at a marked point pt G M„. This definition is similar to the 
definition of the topological A"-groups with coefficients: 

K° {Y,Z„) = K° {YxMn,Yxpt) 

for a space Y. 

Proposition 3.7. The group Kq(Co {Mn,AM, 7 r)) is isomorphic to the group 
of stable homotopy classes of triples , where A',F' E Vect (M x Mn) 

and 
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is an isomorphism over the product X x Mn- Here trivial triples are understood as 
triples induced by a vector bundle isomorphism defined on M x Mn- 

This result is a generalization of Lemma 6.10 to families. The proof is similar 
to that of the lemma. 

The triples introduced in this proposition can sometimes be written out start- 
ing from explicit geometric data on the Z^-manifold with the use of the following 
proposition. 

Proposition 3.8. A triple (E,F,a ) , where 

(3.10) E e Vect (M), Fe Vect (X) , tt, (E\qj^) ^ kF, 
and a is an isomorphism, defines an element of Kq (^M, 7 T 5 ^fc) • 

Proof. On the Moore space we take a line bundle e such that [e] — 1 e 
K {Mk) — Zfc is the generator of the reduced group. We also choose a trivialization 
p:ke^ 

Now consider the triple (E,F,cr). With it we associate the following element 
(in the sense of Proposition 3.7): 

[F s, F, a'] E Kq (Cq 5 

where the isomorphism a' is defined as the composition 

(3.11) TT, ® ~ F ® fee F ® ~ fcF m E\gj^, . 

□ 

2. X-theory with coefficients QjnZ. Now we treat Q/nZ as the direct 
limit of finite groups corresponding to the embeddings 

C Q/nZ, X 1 -^ x/N. 

Then the X-groups with coefficients Q/nZ can also be defined as the direct limit 
Kq {Am, 7 t, Q/nZ) Kq (^M, 7 t, ^niv) • 

3. The X-theory element of a Zn-manifold. The bundle ttiI E Vect(X) 
is fiat, and therefore, for large N there exists a trivialization 

Then the triple [C^, C, a] defines an element of KQ{AM,-K,'^Nn) by virtue of Propo- 
sition 3.8. By letting N 00 , we obtain an element of the X-group with coeffi- 
cients Q/nZ. 

Unfortunately, this construction is ambiguous in the choice of the trivialization 
a, and different trivializations give different elements. 

It turns out that there is a canonical choice of a. Namely, for the covering 
TT : dM X consider the mapping 



f:X—^BSn 
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to the classifying space BSn of the permutation group on n elements. (Here we 
treat the bundle tt gis an associated bundle of the principal *9n-bundle; then / is 
the classifying mapping for this principal bundle.) Moreover, ttiI G Vect(X) is the 
pullback of the universal bundle 7^ G Yectn{BSn) over the classifying space. As- 
sume that the range of / is contained in a finite skeleton (BSn) n' of the classifying 
space. The space BSn onjoys the Mittag-Leffler condition (see [Ati61]): for given 
A', there exists an / > 0 such that 

(3.12) 

for all nonnegative m. 

Now let us choose an N such that the sum of N copies of the restriction of 
the universal bundle 7^ to is trivial. We take some trivialization 

N^n ^ 

Then on M we choose the induced trivialization 

a = ra'. 

One can show that for this special trivialization the X-theory element defined by 
the triple (C^,C, a) is independent of the choice of a' and /. We denote this 
element by 

[ttiI] e Kq {AM,n,Q/nZ) . 

3.5. The index defect formula. 

1. The general formula. 

Theorem 3.9. [SSOl] For an elliptic operator D on a twisted Zn-manifold 
(M, tt), one has 

invD = {[(t(D)], [ml]), 
where (,) is Poincare duality with coefficients: 

(3.13) (,) : X Ko {AM,.,Q/nZ) Q/nZ. 

Sketch of Proof. It is well known in index theory how to compute frac- 
tional homotopy invariants (see [APS76a]). The idea is to express the fractional 
invariant as an index of some family of elliptic operators. Then it suffices to apply 
the Atiyah-Singer formula for families. Let us use this idea in the present situation. 
1. Consider the family 

D* 0 (D (8) Is) :C^ {M.F^E^e) — >C^{M,E^F^e) 

of first-order elliptic operators on M parametrized by the Moore space MnN- (The 
number N will be chosen later on.) Here D* is the adjoint operator, and D 0 
stands for operator D with coefficients in the bundle s G Vect(M^Ar). On the other 
hand, consider the direct sum of N copies of this family. It turns out that the sum 
admits well-posed classical boundary conditions. Indeed, for sufficiently large N 
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the direct sum of N copies of the flat bundle ttiI is trivial. Let us choose some 
trivialization 

(3.14) iVTril-C"'^. 

Then we obtain an isomorphism 

7T! {N E\g^) ~ mN ® Eo 

on the base of the covering and a similar isomorphism 

TT, {N E\gj^) ® ~ TTiiV ® Eo (8) £ ^ 0 Eo <8> £ ~ nNs 0 Eq ^ 0 Eq. 

The corresponding isomorphisms of the spaces of sections are denoted by 
El = a 0 1 : (X, TT, (N E\g^)) {X, 0 Eq) , 

E 2 = (p 0 1) (a 0 1) : C°° {X, TT, {N E\g;^) {X, 0 Eq) . 

In this notation, we deflne the following family of boundary value problems: 

(3 15) I = N(D®h)v = f2, 

{ u\g^ + B2pE v\g^ =g, gec°° {X, 0 Eo) . 

Note that this is not a family of classical boundary value problems, since the 
boundary value g is not a function on the boundary. The boundary condition is a 
nonlocal one — it relates the values of u and v over the whole fiber of tt. However, 
in a neighborhood of the boundary (3.15) is equivalent to a classical boundary 
value problem on the cylinder [0, cxd) x X if one applies isomorphisms of the form 

C^{dM X [0, 1), E) - C^{X X [0, 1), (tt X 1),^) 

to u,u,/i,/ 2 - The latter classical boundary value problem is elliptic. Thus, (3.15) 
is a family of Fredholm boundary value problems (more on this class of nonlocal 
boundary value problems can be found in [SSOl]). By we denote the family 

(3.15) for some given trivialization a. 

2. By virtue of the embedding Z^iv C Q/nZ, we can treat the index-residue 
md^a{D) G K{MnN) — '^nN of the family as a fractional rational number. The 
main step in the proof of the defect formula is the following result. 

Lemma 3.10. One has 



irivD = ind ^o,{D) G M/nZ 

{provided the trivialization a is chosen as in Subsection 3.4). 

Proof of the Lemma. It is well known that the index of a boundary value 
problem, say {D,B), can be decomposed as the sum of the index of the spectral 
boundary problem for the operator D and the index of the boundary operator B 
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restricted to the spectral subspace of the tangential operator. For the family (3.15) 
this gives 

(3.16) ind^a(D) - iVind(D,n+(A))([£] - 1) 

+ ind((Si + B2)/3e ■■ NlmU- {A) © Nlmll+ (yl) ® e — >C°° ® Eq)) 

Let us now compute the index of the boundary family. To this end, we decom- 
pose the target space as the direct sum 

C°° ®Eo) ~ (nMmn_ Oo)) © (nAfe®Imn+ (ylo)). 

Here the isomorphism is defined by the formula 

(niVImH. (Ao)) 0 {nNe^lmU^ (Ao)) (X,C^^ 0J5o) 

U,V l-> U 0 (p 0 l)u. 

This enables us to decompose the operator family {Bi B 2 ) I3e in Eq. (3.16) as 

the direct sum (modulo compact operators). Hence, the index of this family is also 
a sum 

(3.17) ind(5i 0 B 2 )Pe — indpE 0 ind(7V'ImH_ (ttiA) nA^ImH_ (v4q)) 

0 ind(MmH+ {mA) niVImn+ (Aq)) [^] 

= 00 ind[A^ImH+ {7T\A) nA^ImH+ (Aq)] (—10 [^]) 

The index of an elliptic operator (not a family!) in the square brackets can be 
expressed in terms of 77-invariants by the Atiyah-Patodi-Singer “index formula for 
fiat bundles” [APS76a] 

(3.18) ind(lVImn+ {mA) „ATlmn+ {Aq)) 

= Nr) (A) - nNr] (Aq) + ([a (Aq)] , [ttiI]) , 
where the brackets stand for the pairing 

(3.19) (, ) : Kl {T*X) x {X, Q) ^ Q 

of the difference element of the elliptic self-adjoint operator Aq 

[a{Ao)]eK^{T*X) 

and the element [ttiI] G (X^Q) corresponding to the trivialized fiat bundle 
NttiI. (More details on this formula can be found in [Gil95].) 

Substituting (3.18) into Eq. (3.16) and transposing the 77-invariants to the 
left-hand side, we obtain 

invD = md^a{D) 0 {[a (Aq)] , [ttiI]) . 

2) It remains to show that for a special choice of the trivialization (3.14) the 
last term in (3.18) is zero. 

Indeed, consider the classifying mapping 

f:X^ (BS)^, . 
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The computation of the pairing (3.19) can be moved to the classifying space: 

(3.20) ([(j(^o)] , [ttiI]) = {/! [a(Ao)] , [7„]) , [thI] = /* [7„] € (X,Q) , 

where [ 7 ^] G K^{{BSn) the element defined by the trivialized fiat bundle 
Njn- The embedding (55^)^/ C {BSn)pj/_^Lf induces the commutative diagram 

Kl{T*(BSn)r,,)xKmBS„)^,^^„q) - Kl{T*{BSn)j,,)xK\{BSn)j,„Q) 

I i 

Kl{T*{BSr.)„,^^,)xK\{BSn)f,,^^„Q)^ Q. 

It follows from this diagram that the pairing (3.20) gives zero, since the range of 
the mapping 

Kl (T* {BSr.)^,) ^ Kl {T* {BSn)j,,+t^,) 
is contained in the torsion subgroup. 

Therefore, the expression for ind^ a{D) is reduced to the desired relation 

md^a{D) = invD. 

This proves Lemma 3.10. □ 

3. To complete the proof of the theorem, it suffices to relate the families index 
of ^a{D) to the Poincare duality pairing. In the index theory of classical boundary 
value problems, there is a well-known operation of “order reduction,” which reduces 
elliptic boundary value problems to zero-order operators (see [H6r85] or [SS99]). 
This operation preserves the index. Applying this operation to the family ^a{D), 
one can show that the result is a family of admissible operators in the sense of 
Subsection 6.2 of Appendix C. A computation shows that this family of admissible 
operators coincides with the family corresponding to the product of the elements 

[a{D)] e Kc(5^"), M] e Ko{AM,..Q/nZ). 

Since the Poincare duality pairing of two elements is defined as the index, we 
obtain the desired formula for the index of the problem as the Poincare pairing 
with coefficients: ^ 

ind«>„(D) = (K£))], [tt,!]). 

Together with the equality in Lemma 3.10, this completes the proof of the theorem. 

□ 

Remark 3.11. Using the results of Appendix C, one can compute Poincare 
duality topologically for a regular covering tt. In this case, we obtain an index 
defect formula in topological terms. 

2. The index defect in the G-equivariant case. In a number of cases, 
the invariant inv can be computed effectively with the use of Lefschetz theory. 
Suppose we are given an action of a finite group G on M such that the action is 
free on the boundary DM. As a covering tt, we take the natural projection to the 
quotient space: 

7r:dM dM/G. 

Note that we do not require that the action be free in the interior of M. 
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Consider a G-equivariant elliptic operator D on M. By L{D,g) G C, ^ G G, 
we denote the usual contribution to the Lefschetz formula (see [Don78]) of the 
fixed point set of an element g. 

Proposition 3.12. One has 
(3.21) [jiyD = — ^^L{D,g) (modn). 

Proof. Consider the equivariant index ind^ (D,n_^) of the spectral bound- 
ary value problem and the equivariant 77 - function (see [Don78]) of the tangential 
operator A on the boundary. 

By (D, and we denote the restrictions of the corresponding operators 

to the spaces of G-invariant sections. Clearly, A^ is equivalent to Aq on the base 
of the covering. On the other hand, one can express the usual invariants in terms 
of their equivariant counterparts: 

ind(D,n+)‘^ = y]indg(D,n+) , V 

' ' gsG II g€G 

This is easy to check with the use of character theory. By virtue of these expres- 
sions, we can rewrite invD as 

invD = inde {D, 11+) -'^ri{A,g). 

g^e 

The ? 7 -invariants here can be expressed by the equivariant Atiyah-Patodi-Singer 
formula (see [Don78]): 

-7? {A, g) = indg {D,Il+) - L{D,g) . 

Thus, we obtain 

invD= \G\ind{D,n+f -J2L{D,g). 

This gives the desired equation (3.21). □ 

3.6. An application to r/- invariants. The index defect formula enables one 
to express the fractional part of the 77 -invariant in the following situation. 

Let M be an even-dimensional spin manifold such that its boundary is a 
covering with spin structure coinciding with that induced from the base. Let us 
also choose a vector bundle E G Vect (M) that at the boundary is the lift of some 
bundle Eq G Vect (A). In a collar neighborhood of the boundary, we take a product 
metric on M that is the lift of some metric from the baise. Finally, we choose a 
similar connection in E, 

Proposition 3.13. The Dirac operator Dm on M with coefficients in E sat- 
isfies the assumptions of Theorem 3.9, and one has the formula 

iv {Dx ® IbJ} = 1 (y I (M) chE - ([a {Dm)] , [Gi] )) G R/Z, 

M 
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for the fractional part of the r]-invariant of the self-adjoint Dirac operator Dx with 
coefficients in the bundle Eq on the base of the covering. 

Proof. This formula follows from the defect formula, where the index of 
the spectral boundary value problem is expanded by the Atiyah-Patodi-Singer 
formula 

ind(L)M,n+) = J A{M)chE-r]{DdM)^ 

M 

□ 



4. Appendix A. The Atiyah-Patodi— Singer 77 -invariant 

In this appendix, we give a brief overview of the spectral 77-invariant. Most of 
the results were proved in the original paper [APS76a], and there is also a very 
stimulating exposition in [BBW93]. Therefore, here we either omit the proofs or 
only indicate the main idea. 

4.1. The geometric index formula and the 77 -invariant. Atiyah-Patodi- 
Singer [APS 75] gave a formula for the index of spectral boundary value prob- 
lems for geometric first-order operators. Namely, using the heat equation method 
[ABP73], they obtained the formula 

ind(An+(A))= / a(D)- 77(A) 

Jx 

for the index of the spectral boundary value problem on a manifold X for an 
operator having the form ( 1 . 1 ) near the boundary. The first contribution is defined 
by the constant term a{D) in the local asymptotic expansion of the heat kernel 

tr(e“^^ ^ {x^x)) — tr{e~^^^ {x,x)) 

as t ^ 0 . This term is determined just as in the case of operators on closed 
manifolds as some algebraic expression in the coefficients of the operator. The new 
feature of the spectral boundary value problem is the so-called r]-invariant of the 
tangential operator A. Let us recall its definition. 

Let A be an elliptic self-adjoint operator of some positive order on a closed 
manifold M. The r]-function of A is defined by the formula 

v{A,s)= = 

Aj G Spec A, A j 7^0 

It is analytic in the half-space Res > dimM/ordD (where the series is absolutely 
convergent). This spectral function is a generalization of the C-function 

C(AI,S)= ^ |A,r 

AjGSpecA 

of positive definite elliptic operators. By analogy with the ^-invariant 

C(A) = ic(A0), 
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it is natural to introduce the following definition. 



Definition 4.1. The r]-invariant of A is the number 



(4.1) 



7] (A) — ^(rj {A, 0) + dim ker A) C ' 



Of course, for this definition to make sense, it is necessary to have an analytic 
extension of the 77- function to the point s = 0. Analytic methods show that the 
77- function extends meromorphically to the entire complex plane, possibly with a 
simple pole at the origin. Atiyah-PatodDSinger [APS76a] for odd-dimensional 
manifolds and Gilkey [Gil 81 ] for even-dimensional manifolds proved, using global 
topological methods, that the residue at the point 5 = 0 is nevertheless zero. Thus, 
the 77-function is holomorphic at s = 0 and the 77-invariant is well defined. 

The 77-invariant is by definition only a spectral invariant, and it can vary for 
a deformation of the operator. Consider an example. 

Example 4.2. On the circle of length 2tt with coordinate (/:, consider the 
operator 

At — —l— h t. 

d(f 

Here t is some real constant. Let us compute the 77-invariant. Since the spectrum 
is given by the lattice t -h Z (with period one) , it follows that the 77-invariant is 
a periodic function of the parameter t. Thus, we can suppose that 0 < t < 1. 
Collecting the eigenvalues in pairs, we can rewrite the 77- function as 



rj(At,s) = Yl^{n + t) ’"-(n-t) 

n>l 



~h t 



Let us show that this series absolutely converges on the real line for s > 0 and 
compute the limit as s ^ +0. By the Taylor formula, we have 

[(n + t)-'* -{n- = - 2 tsn~^ + O (^) • 



Thus, as s — > +0 we obtain 



E 

n>l 






2 ts n 

n>l 



-r 



'^dx = — 2L 



and for the 77-invariant we have 

rj{At,0) H- dim ker At 
^ 






where { } G [0, 1) is the fractional part of a number. Hence, for a smooth family 
At of elliptic operators the corresponding family of 77-invariants is only piecewise 
smooth. In addition, the jumps (which are integral!) occur for parameter values 
such that some eigenvalue changes its sign. Let us also mention the half- integer 
parameter values t € Z-h 1/2, where the spectrum of At is symmetric with respect 
to the origin. For these values, the 77-function vanishes identically. In this case, one 
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says that the operator At has a spectral symmetry, and the 77-invariant is regarded 
as a measure of spectral asymmetry of the operator. 



4.2. The derivative of the r^-invariant. It turns out that the 77-invariant 
is a piecewise smooth function of the parameter in the general case as well. More 
precisely, the following result is valid. 

Proposition 4.3. [APS76a] For a smooth family of elliptic self- 

adjoint operators, the following assertions hold. 



(1) If the operator At^ is invertible, then the function rj{At) is smooth in 
a neighborhood of to and its derivative can be expressed in terms of the 
derivative of the (^-function of the auxiliary family 



Bt,to — l^tol + - ^0) ( 



T=to 



Namely, 



(4.2) 






t— to 






t=to 



(4.3) 



(2) In the general case, rj{At) is piecewise smooth and can be decomposed in 
the form 

t' 

r]{At') -r]{Ao) = J (v (to) dto + sf {At)t^,o tn , 

0 

[ 0 , 1 ], 

as the sum of a smooth function of the parameter and a piecewise constant 
function sf called the spectral flow {see Subsection 1.2). Here 



^t,tQ — l^tol d- Pker AtQ + ^o) ^ 



r=to 



and Pker AtQ the orthogonal projection on the kernel of Atg . 
Corollary 4.4. The fractional part 

{v {At)} eR/Z-S^ 

of the r]-invariant is a smooth function of the parameter t for a smooth family At. 



In the general case, the 77-invariant is not homotopy invariant and can take 
arbitrary real values. 



4.3. The homotopy invariance of the 77 -invariant. It turns out, however, 
that in some special operator classes the 77-invariant possesses homotopy invari- 
ance. To this end, it is necessary that the two components in the decomposition 
(4.3) vanish. The easiest way to eliminate the second component, i.e. the spectral 
flow, is to consider only the fractional part {77 (A)} of the 77-invariant. To obtain the 
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vanishing of the second component, it is convenient to use the formula for the de- 
rivative on the left-hand side in Eq. (4.2). Seeley [See67] proved (see also [Agr94] 
and [GS95]) that the value of the (-function at the origin can be expressed via 
the complete symbol of the operator. Explicitly, for a positive self-adjoint operator 
A with complete symbol having the asymptotic expansion 

(7 (AJ QjYn 1 4“ ^m — 2 “1“ •••? 

the (-invariant is computed by the following procedure. Let us define the symbols 
b-m-j, j > 0 , by the recursion relations 

(4.4) 

b—m—j {A"> i,\) {a^{x,i)-\) 

a\ 

/e+/ + |a|=j, 

/>0 

The symbols in (4.4) depend on the coordinates a;, momenta (, and additionally 
on the parameter A. In this notation, the (-invariant is given by 

CXD 

(4.5) 2( (t4) = — ~ / dxd^ / b- dimM-ordA dX. 

(2'k) ordA J J 

^ ' S*M 0 

Note the following properties of this formula. 

(1) (Locality.) For two locally isomorphic operators A and A' , their (-invar- 
iants coincide: 

C(^) = C(^'). 

(Operators are said to be locally isomorphic if their complete symbols 
coincide in a neighborhood of every point of the manifold in some coor- 
dinate system for some trivializations of vector bundles.) 

(2) (Homogeneity.) The terms bj are positively homogeneous functions: 

bj (x, t'^X) {—'^y bj (x, (, A) , t > 0. 

These properties enable one to find classes of operators where the derivative 
of the 77 -invariant in Eq. (4.2) is zero. Let us introduce some of the known classes. 

First, we define a class of pseudodifferential operators that generalize differ- 
ential operators. 

Definition 4.5. A classical pseudodifferential operator A with complete sym- 
bol 

cr(A) 

T ^m— 1 + — 2 + ... 

is said to be R^-invariant if the components of its complete symbol are homoge- 
neous functions 

Oj (x,t() = t^Oj (x,() , t G M*, 
with respect to the group of nonzero real numbers 
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To define the second class of operators, recall that a. flat bundle 7 G Vect (M) is 
a vector bundle with locally constant (i.e. constant on connected subsets) transition 
functions. For an operator 

A : (M, E) — > (M, F ) , 

one can define an operator with coefficients in the flat bundle, denoted by 
A (g) (M, F; (8) 7) ^ (M, F ^ 7) . 

This is locally isomorphic to the direct sum of dim 7 copies of A. One can globally 
define this operator by gluing the local complete symbols of A with the use of a 
partition of unity. We also require that the transition functions of a flat bundle be 
unitary. 



Example 4.6. On the circle with coordinate cp, consider the vector bundle 
7 with the transition function Then the operator 



. d 

'^dp> 



+ 1 



from Example 4.2 is locally isomorphic to —2^ 0 1^. The isomorphism 




is given by the trivialization e^^"^ of 7. 




+ 1 



Theorem 4.7. [APS76a], [Gil89a] The fractional part of the r} -invariant is 
homotopy invariant in the following two classes of elliptic self-adjoint operators: 



(1) the class of direct sums 

A 0 0 (— dim7A) 

with a given flat bundle 7 G Vect(X); 

(2) the class of 'R^-invariant operators if the following parity condition is 
satisfied : 

(4.6) dim A + ordM = 1 (mod 2) . 



Proof. 1) The main idea of the proof is to use the locality of the (^-invariant. 
More precisely, for the fractional part of 77 one has 

{rj (A 0 © (-72A))} = {77 (A 0 1^)} - {nrj (A)} , n = dimy. 

Then for a smooth homotopy At this gives (see Eq. (4.2)) 






T = to 



A similar formula 

is valid for the derivative of the operators with coefficients in the flat bundle. 
Recall that A 0 and nA are locally isomorphic. Therefore, the positive definite 
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operators Bt and B[ are locally isomorphic as well. Therefore, the locality of the 
(■-invariant gives the desired relation 

This proves the homotopy invariance. 

2) Consider first the case of even-order operators. It is easy to see that for a 
homotopy At the corresponding positive definite operators Bt (see Eq. (4.2)) are 
also -invariant. By induction, this gives the -homogeneity 

(4.7) bj = (-!)■' bj 

of the coefficients corresponding to Bt (see the recursion relations (4.4)). Hence, 

oo 

^ = ^C(A) = Const4( j dxd^' J b-iirnM-ordA{x,^,-X,t)d)^. 

S*M 0 

Using the homogeneity (4.7) and the assumption that the manifold is odd-dimen- 
sional, we see that the integrand 6- dim M-ordA (^^C? is an odd function on 

the sphere S*M. Therefore, the integral is zero, and we obtain the desired relation 

|{.(A)} = 0. 

For odd-order operators, one obtains the different homogeneity 
bj {x, -C A, -t) = bj (x, C A, t ) . 

Substituting these homogeneous functions into the expression for the ^-invariant, 
we obtain 

This gives the desired homotopy invariance of the fractional part of the 77 - invariant: 

|{.(A)} = |C(A) = 0. 

□ 

Remark 4.8. Note that in the proof we also obtained the vanishing of both 
the derivative and the (^-invariant itself for M* -invariant even-order operators on 
odd-dimensional manifolds. 

5. Appendix B. Elliptic operators and Poincare duality. Smooth 

theory 

In this appendix, we show that Poincare duality in Tf-theory on smooth man- 
ifolds can naturally be described in terms of elliptic operators. We consider both 
closed manifolds and manifolds with boundary. Using the Poincare isomorphism, 
we construct Poincare duality as a nonsingular pairing. In this context, the Atiyah- 
Singer index theorem can be used to make the pairing effectively computable. The 
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topics covered in this appendix can also be found in the recent book [HROO]. Our 
approach is closer to differential equations. 

5.1. The Poincare isomorphism on a closed manifold. 

1. Atiyah’s generalized elliptic operators. It is well known that for a 
sufficiently nice topological space X (e.g., a finite CVK-complex) there is a pairing 

(5.1) Z) X W{X, Z) — > Z 

of homology and cohomology groups. (The pairing is nondegenerate on the free 
parts of the groups.) A similar pairing can be constructed in K-theory on a smooth 
closed manifold M. Namely, we consider the pairing 

(5.2) (, ) : K^{T*M) x K%M) — > Z 

taking the difference element G K^{T*M) of an elliptic operator 

D : C^{M,E) — > C^{M,F) 

and a vector bundle G G Vect(M) to the index of D with coefficients in G.® The 
pairing (5.2) is nondegenerate on the free parts of the groups. (This can be proved 
by using the Atiyah-Singer index formula and by passing with the use of the Chern 
character to cohomology.) Comparing (5.1) and (5.2), we can make a guess that 
the K -homology groups of M can be defined in terms of topological A-theory: 

(5.3) Ko{M) K°{T*M). 

Unfortunately, this definition has a significant drawback, since the right-hand side 
of the formula does not make sense for a singular space M. Nevertheless, the right- 
hand side of (5.3) can be defined for an arbitrary compact space provided that we 
interpret K^(T*M) as the group of stable homotopy classes of elliptic operators 
on M. 

Atiyah [Ati69] suggested the following abstract notion of an elliptic operator. 

Definition 5.1. A generalized elliptic operator over a compact space A is a 
triple (D,i7i,i/2), where 

D: Hi 

is a Fredholm operator acting in the Hilbert spaces Ffi, these spaces are mod- 
ules over the C*-algebra C{X) of continuous complex- valued functions on A, and 
D almost commutes with the module structure; i.e., 

[D,f]eK: 

for all / G G(A), where /C is the space of compact operators from Hi to H 2 . 



^Recall that an operator with coefficients in a vector bundle has the principal symbol 
cr{D) ^ 1 g • TV* {E G) — 

Any operator with this symbol is denoted by D 1 q. 



7T*{F^G). 
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Note that the compactness of the commutator in this definition originates 
from the fundamental property of differential operators on manifolds: for a smooth 
function /, the order of the commutator [D, f] is at most the order of D minus 
one. 

Atiyah showed that generalized elliptic operators on a compact space X define 
elements in the K-homology group Kq{X) of the space, where Kq is the generalized 
homology theory dual to topological K-theory. Atiyah also conjectured that the 
K-homology groups can be defined solely in terms of generalized elliptic operators. 
This conjecture was proved by Kasparov [Kas73] and independently by Brown- 
Douglas-Fillmore [BDF77]. It turned out more convenient to work with a certain 
modification of Atiyah’s original definition. 

We start from the description of the even group Kq{X). (The odd groups 
Ki{X) will be introduced later.) 

2. Even cycles and the group Kq{X). This group is generated by so-called 
even cycles. 

Definition 5.2. An even cycle in the JT-homology of a space A is a pair 
(F, H) given by a Z 2 -graded Hilbert space 

where the components i7o,i are ^-modules over the C*-algebra C{X), and an odd 
(with respect to the grading) bounded operator 

F:H H. 

The operator and the module structure have the properties 

(5.4) /(F-F*)~0, /(F2-1)~0, [F,/]~0 for all / 6 C(X), 

where means equality modulo compact operators. 

The even K-homology group Kq{X) can be obtained by introducing some 
equivalence relation on the cycles. The simplest one is the stable operator homo- 
topy. (See [Bla98], chapter VIII, where one can find a number of other equivalence 
relations on cycles. These relations are pairwise equivalent.) Let us define this re- 
lation. 

Two cycles are said to be isomorphic if the corresponding (7(X)-modules H 
are isomorphic and the operators F coincide under this isomorphism. Two cycles 
are homotopic if they become isomorphic after some homotopy of the operators 
F. A trivial cycle is a cycle for which all relations in (5.4) are satisfied exactly. 
Finally, two cycles are stably operator homotopic (for short, stably homotopic) if 
they become homotopic after adding some trivial cycles to each of them. 

One can show that the set of stable homotopy classes of even cycles is an 
abelian group with respect to the direct sum. This group is denoted by Kq{X). It 
is called the K -homology group of the space X. 

Remark 5.3. The A-homology groups behave covariantly for continuous map- 
pings. Consider a continuous mapping f : X Y. Then a cycle (F, if ) over X 
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can be treated as a cycle over V if the C(F)-module structure on If is defined 
as the composition of the induced mapping f* : C(V) C(X) with the original 
C(X)-module structure on H. This mapping of cycles induces a homomorphism 

/, : Ko{X) Ko{Y). 

After these definitions, it is almost a tautology to say that ordinary elliptic 
operators on closed manifolds define K-homology elements. However, because of 
its importance, we describe the corresponding construction in detail. 

Namely, consider an elliptic pseudodifferential operator 

D : C^{M,E) — ^ C^{M,F) 

acting on sections of some bundles E and F on a closed manifold M. Then its 
partial isomorphism part 

D' = {PuerD+D*D)-^^^D 

(Fker D is the projection on the kernel of D) in the polar decomposition defines a 
Fredholm operator 

D' : (M, E) (M, F ) , 

where both spaces are C (M)-modules. (The module structure is the pointwise 
product of functions.) Moreover, D' commutes with the module structure up to 
compact operators. For smooth functions, this follows from the composition for- 
mulas for pseudodifferential operators. Then the general case follows by continuity. 
We define the matrix operator 



Then F is a self-adjoint odd operator on the naturally Z 2 -graded C (M)-module 
H = L‘^ (M,E) 0 (M, F). Thus, the pair (F, F) is an even cycle. The corre- 

sponding element in F-homology is denoted by 

(5.5) [D] e Ko(M). 

3. The quantization mapping. This construction can be interpreted in 
quite a different way. Namely, the principal symbol of D 



a{D) : 7t*F 



7T : T*M • 



is a vector bundle isomorphism over T*M except for the zero section. The corre- 
sponding difference element in F- theory with compact supports is denoted by 

(5.6) [a{D)] € K°{T*M). 

Considering two elements (5.5) and (5.6) together, one can readily show that there 
is a well-defined mapping 



Q : K^{T*M) 



Ko[M), 

[D\, 
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which sends symbols to the corresponding operators. This mapping is naturally 
called the quantization mapping. It is well defined on homotopy classes, since 
operators with the same symbol are homotopic. 

4. Odd cycles. We have defined the group Kq{X) in terms of even cycles. 
The odd group Ki{X) is generated by odd cycles. 

Definition 5.4. An odd cycle in the K-homology of a space X is given by a 
Hilbert space H that is a ^-module over C{X) and a bounded operator 

F:H 



such that 

(5.8) /(F-K)~0, /(F2-1)~0, [F,/1~0 

for an arbitrary function /. 

The only difference between odd and even cycles is in the Z 2 -grading structure. 
The set of stable homotopy classes of odd cycles on X is denoted by Ki{X). 
Let us show how odd cycles arise from elliptic self-adjoint operators on closed 
manifolds. Consider an elliptic self-adjoint operator 

A : C^(M, E) — > C^{M, F). 

We can extend it to the L^-spaces of sections (if the order of A is zero). This 
gives the odd cycle (L^(M, ^),(1 + if ordA > 0. The corresponding 

A-homology class is denoted by 

[A] G Ki(M). 

On the other hand, the principal symbol of A defines a difference element 

[<t(.4)] G Kl{T*M). 

Let us recall its definition (see [APS76a]). The principal symbol of an elliptic 
self-adjoint operator is an invertible Hermitian endomorphism of a bundle over 
the cosphere bundle S^'M. Hence, over S^M we can consider the vector bundle 
denoted by Im cr(H_|_(A)) and generated at a point (x, G by the eigenvectors 
of the symbol cr(A)(x, corresponding to positive eigenvalues. Then the difference 
element is defined by the formula 

[a{A)]=d[\mU+{A)\eKl{T*M), 

where 

d:K{S*M) ~^Kl{rM) 

is the coboundary mapping in the A-theory of the pair S*M C B*M. (Here 
is the bundle of unit balls in T*M with respect to some Riemannian metric, and 
the cosphere bundle S*M is realized as its boundary.) 

By analogy with the even case, there is a well-defined quantization mapping 

Q:Kl{T*M) Ki{M), 

[(t(^)] [A]. 



(5.9) 
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This is well defined, since the coboundary d induces an isomorphism 
K{S*M)/K{M) - 

A classical theorem (see [Kas88]) claims that the quantization mapping is an 
isomorphism. This isomorphism is called the Poincare isomorphism. 

Theorem 5,5. (The Poincare isomorphism.) The quantization mappings given 
by (5.7) and (5.9) define isomorphisms 

Q: A*(T*M) ^X*(M), 

where the index * is either 0 or 1 . 

The proof can be found in [Kas88]. 

5.2. Duality and the topological index. As was already mentioned, K- 
homology is dual to topological A-theory. The most important manifestation of 
this duality is the pairing 

(5.10) {,) : Ki{X) X K\X) — ^ Z, z = 0,l, 

which we define in this subsection. The pairing (5.10) will be defined as the com- 
position of the product 

(5.11) KfiX) X K\X) Ao(X) 
with the mapping 

P! : Ao(A) ^ Ao(pt) = Z 
induced by the projection of X into a one-point space. 

Let us start by saying that p\ takes a Fredholm operator to its analytic index. 
Indeed, an even cycle over a point is just a Fredholm operator, and Fredholm 
operators have only one stable homotopy invariant, namely, the index. This shows 
that Ko{pt) = Z. 

It remains to define the product (5.11). Let us consider it for i = j = 0. 

The formula for the product (e.g., see [Ati69]) for a general element of the 
group Kq(X) mimics the construction of an operator with coefficients in a vector 
bundle. Namely, this mapping takes a cycle (F, H) and a vector bundle G to the 
even cycle 

where P : is some projection over X defining G and 

Ih<8>P{H0C^)cH^C^ 

is the range of the projection 1h ^ F. Thus, the pairing {[D], [G]) of an elliptic 
operator D with a bundle G can be computed by applying the Atiyah-Singer 
formula to F 0 1^: 

([F],[G])=ind,(F^lG). 

Let us also mention that the product of odd groups 

Ki{X) X K\X) ^ Ko{X) 
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is defined in the spirit of the theory of Toeplitz type operators (see [BD82]). 

Comparing the constructions of the present section with the de Rham theory, 
one can make the following glossary of similar terms: 



de Rham theory 


Elliptic theory 


cohomology H"^{M) 


topological A-theory K*{M) 


homology H^{M) 


A-homology K^{M) 


cocycle lu, dw = 0 


vector bundle E 


cycle 7 , ^7 = 0 


elliptic operator D 


integral 


index ind(D (8) l^;) 



5.3. Poincare duality on manifolds with boundary. Absolute and 
relative cycles. Let us now consider duality for manifolds with boundary. 

Let M be a compact smooth manifold with boundary DM. In this case, one also 
has Poincare duality, frequently called Poincare-Lefschetz duality. In (co) homology 
(for oriented M), the duality amounts to two group isomorphisms 

H\M) — > (M, dM ) , dM) — > n = dim M. 

Thus, duality relates the ordinary groups to the so-called relative groups. 

Let us define similar isomorphisms in A-theory. For a manifold M with bound- 
ary, one has two natural i^-homology groups: the ordinary group K^{M) and the 
so-called relative K -homology group K^{M,dM). The relative groups are defined 
as follows. 

It is clear that in Definition 5.2 we have used only the algebra C{M) of func- 
tions on M. At the same time, a manifold with boundary has another natural 
C*-algebra, namely, the algebra Co{M\dM) of functions vanishing at the bound- 
ary. We denote the group generated by cycles over Cq{M \ dM) by K^{M,dM) 
and call it the relative K -homology of the manifold. 

Let us show how elements of these groups arise from elliptic operators on 
manifolds with boundary. On the analogy with homology theory, we refer to cycles 
over the algebra C{M) as absolute cycles and cycles over Cq{M \ dM) as relative 
cycles. 

We first describe the ordinary (absolute) cycles. 

1. Elliptic operators and absolute cycles. In this case, we consider elliptic 
operators D induced near the boundary by vector bundle isomorphisms. Just as 
in the case of closed manifolds, such operators almost commute with functions 
/ e C{M): 

[A/]~o. 

Therefore, the construction of the previous subsection can be carried out word for 
word in this case; i.e., D defines a A-homology class 

[D] e K^M). 
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On the other hand, the principal symbol of such an operator is an isomorphism 
on T*M everywhere near the boundary. Hence, the operator D has a difference 
element 

[a{D)]eK:{T*{M\dM)). 

Remark 5.6. This class of zero-order operators induced in a neighborhood 
of the boundary by vector bundle isomorphisms naturally arises in index theory 
of classical boundary value problems. Namely, the classical procedure of order 
reduction (see [H6r85] or [SSS99b]) reduces a boundary value problem for a 
differential operator to a pseudodifferential operator of order zero of precisely the 
form considered here. Moreover, the reduction preserves the index. 

2. Elliptic operators and relative cycles. Relative cycles arise as follows. 
An elliptic operator D of order one on M defines an element 

[D]eK, (M,dM), 

which can be constructed as follows. Consider an embedding M C M of M in some 
closed manifold M of the same dimension. Let D be an arbitrary extension of D 
to this closed manifold as an elliptic operator. On M we consider the zero-order 
operator 

^ ^ x-l/2^ 

F=n-\-D*D] D. 

The restriction of this operator to M is defined as 
(5.12) F = i*Fu:L^{M,E)^L'^{M,F), 

where i, : (M) — > (^) extension by zero and i* : (^) (^) 

is the restriction operator. 

If D is symmetric, then one can readily verify that F satisfies the properties 

F - F* - 0, / (f2 - 1) - 0, [F, /] - 0 

for a function f ^ Cq (M\dM) vanishing on the boundary. These relations show 
that F defines an element in Ki {M^dM). 

If D is not symmetric, then instead of the operator F one considers the corre- 
sponding matrix operator as in Subsection 5.1. In this case, the pair (F, H) defines 
an element of the group Kq (M, dM ) . 

3. The quantization mapping and the Poincare isomorphism. For 

elliptic operators defining absolute cycles on manifolds with boundary, we obtain 
two elements 

[(7(F)] G F,*(T*(M\SM)), [D] G F,(M). 

Similarly, operators corresponding to relative cycles also define a pair of elements 
[(j(F)] G F*(T*M), [D] G F,(M,dM). 
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(Here [cr{D)] is the Atiyah-Singer difference element of D.) One can show that the 
corresponding quantization mappings 

Q : K*{r{M \ dM)) K,{M), 

(5.13) K*(T^M) K,{M,dM), 

\a{D)] ^ [D] 

are well defined. It was proved in [Kas88] that both quantization mappings are iso- 
morphisms. They are called the Poincare isomorphisms in K -theory on manifolds 
with boundary. 

4. The exact sequence of a pair in AT-homology. It is well known that 
in A-homology for an embedding dM C M there is a six-term exact sequence 

(5.14) Ko (dM) ^ Ko (M) 




Ki (M) ^ Ki (dM) 



The boundary maps in this sequence can be explicitly computed (see [BDT89] or 
[MP92]). It turns out that this sequence is isomorphic to the exact sequence of 
the pair T*M\qm C T*M in topological A-theory: 

(5.15) 



Kc {T*dM) ^ Ac (T* {M\dM)) 




Kl (T* {M\dM)) ^ Kl (T^dM) 



The isomorphism can be obtained by applying the quantization mappings term by 
term to the sequence (5.15). 

6. Appendix C. Poincare duality on Zn-manifolds 

In this section, we construct Poincare duality for Z^-manifolds (see [SSOl]). 
Unfortunately, these manifolds with singularities have no duality in the framework 
of the usual topological A-groups. Quite remarkably, however, the duality can be 
restored if one applies the approach of noncommutative geometry [Con94] to 
this problem and states duality in terms of A-theory of some noncommutative 
algebras of functions on the corresponding spaces. We show that the approach of 
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noncommutative geometry, at least for manifolds, can be completely described 
in terms of elliptic operator theory. 

Before we proceed to the description of duality for Zn-manifolds, we recall the 
main features of the passage from topological K-theory to /^-theory of algebras. 
This passage goes as follows. 

(1) The topological group K^{X) of a compact space X can be identified 
with the Grothendieck group of homotopy classes of projections in matrix 
algebras over C{X). Clearly, this definition makes sense for an arbitrary 
unital C* -algebra A. The corresponding group is denoted by Ko{A). 
Similarly, the odd group K^{X) is identified with the group of stable 
homotopy classes of unitary operators in matrix algebras over C{X). 
The similar group for a C*-algebra A is denoted by Ki{A). Summarizing, 
the new groups are reduced in the commutative case to the topological 
jRT-groups 

K^{X)^K.{C{X)). 

(2) i^-homology. It is clear from Definition 5.2 that the definition of the K- 
homology group of a space uses only the C*-algebra of functions on it. 
Therefore, the same definition for an arbitrary C*-algebra A gives two 
groups K^{A) and K^{A). These groups are generated, respectively, by 
even and odd cycles over A. 

Remark 6.1. We note the change of variance of the functors (and the corre- 
sponding change in the position of indices). For example, an analog of the topo- 
logical K-groups is the group K^{A), which is a covariant functor with respect to 
algebra homomorphisms. Similarly, the iT-homology of spaces translates into the 
RT-cohomology (a contravariant functor) of algebras. 

For a nonunital algebra A, the i^o-group is defined as the kernel of the natural 
surjective mapping 

Ko{A) = ker {Ko{A+) — » Ko(C)) , 

where A~^ = ^ 0 C is the algebra with attached unit. The mapping is induced by 
the algebra homomorphism ^0C ^ C. The Ki-group is defined slightly simpler: 

KoiA) = Ki{A+). 

The construction is similar to the definition of topological i^-theory for locally 
compact spaces (see [Ati89]). 

6.1. Relative cycles. The (7*-algebra of a Z„- manifold. Since a Z„- 
manifold for n = 1 is just a smooth manifold with boundary, it is natural to 
construct duality separately for relative and absolute cycles. 

Consider a twisted Z^-manifold (M, tt) (see Definition 3.1), or a Zn-manifold 
for short. On M, we take some elliptic operator 

D : C^{M,E) — > C^{M,F) 
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satisfying Assumption 1. Its principal symbol defines a difference element 

(6.1) [a{D)] G K,{T^) 

of the topological A-group of the Z^-manifold {T*M,7t). Note that (6.1) includes 
additional information (compared with the image of [cr{D)] in KdT'^M)) related 
to the structure of the space T*M . Let us define a similar element in A-homology. 
Note that by assumption, the operator D almost commutes both with functions 
/ G Co{M \ dM) and with transpositions of the sheets of tt in a neighborhood of 
the boundary. 

By Am, TV we denote the C*-subalgebra of operators in L^{M) generated by 
multiplications by functions / G Cq{M \ dM) and transposition operators in a 
neighborhood of the boundary. If we take a neighborhood of the boundary where 
transpositions of the sheets are allowed and denote the complement of this neigh- 
borhood by M', then the algebra can be explicitly described in the form 

2 /GCo(M'),^gCo(Xx (0,l],End7r,l) ) 

= «lt=l J 

as a subalgebra in the direct sum Cq (M') 0 Cq (X x (0, 1] , EndTTil). Here EndTTil 
is the vector bundle of endomorphisms of ttH G Vect(A). 

Remark 6.2. The algebra Am,tt can also be defined as the (7*-algebra of the 
etale-groupoid [BN94] corresponding to the extension of the equivalence relation 

(3.2) to the neighborhood of the boundary. 

Under Assumption 1, one can prove the following result. 

Lemma 6.3. The spaces L^{M^ E) and L‘^{M^ F) have a natural module struc- 
ture over the algebra Am,-k such that D almost commutes with this module struc- 
ture. Thus, D defines a class [D] G K*{Am,tt)‘ 

Proof. By Assumption 1, in a neighborhood of the boundary one has vector 
bundle isomorphisms 




E - 7t*Eo, Eq G Vect(A x [0, 1]). 

In a similar way, for the spaces of sections we have 

C{dM X [0,1], E) -C{X X [O,l],7r.l0Eo). 

The latter space has a natural Co (X x (0, 1] , End7r!l)-module structure. This 
module structure can be glued with the C(M)-module structure on the entire 
manifold, thus defining the desired module structure over the algebra Am, 7 t- A 
similar construction applies to F. The desired almost commutativity of D with 
the elements of Am, 7 t follows from the equivariance of D with respect to transpo- 
sitions of sheets of the covering. □ 




228 



ANTON SAVIN AND BORIS STERNIN 



6.2. Absolute cycles. Nonlocal operators. Clearly, the relative cycles on 
a Zn-manifold were obtained in the previous subsection by restricting the class of 
operators to those almost commuting with the algebra Am, tv- In this subsection, 
we enlarge the class of absolute cycles on M requiring only that the operators in 
question almost commute with elements of the algebra of continuous functions on 
the singular space M but not of the larger algebra 

C(M) D C{W). 

1. Definition of the class of operators. Needless to say, ordinary absolute 
cycles on M (represented by elliptic operators of order zero induced by vector 
bundle isomorphisms near the boundary) are cycles for the algebra C{M ) as 
well. However, there are also more general cycles on the space M . To find them, 
let us replace C{M ) by a homotopic algebra of functions on M that are lifted from 
the base of the covering in a given neighborhood of the boundary. We denote this 
algebra by the same symbol. Here is an “heuristic derivation” of relative cycles. 

Consider some operator D on M. In a neighborhood of the boundary, its 
direct image (tt x 1)\D acts on the base of the covering tt x 1 ; dM x [0,1) ^ 
X X [0,1). The spaces in which the operator acts have the usual C(X)-module 
structure (determined by the pointwise product of functions) . Therefore, D almost 
commutes with functions in C{M ) if (a) it is a pseudodifferential operator far 
from the boundary and (b) its direct image in a neighborhood of the boundary is a 
pseudodifferential operator on the base. Thus, we arrive at the following definition. 

Definition 6.4. An admissible operator on M is an operator of the form 
(6.2) D = + 'll;" (tt-D") p", 

where 

D' : C^{M,E) C^{M,F) 

is a pseudodifferential operator of order zero on M, 

D" : C^{X X [0, 1], (tt X l)!^:) — > C^{X x [0, 1], (tt x 1),F) 

is a pseudodifferential operator on A x [0, 1], the cutoff functions ip' and -0' vanish 
in a neighborhood of the boundary, and p" and 'ip" vanish in a neighborhood of 
the subset A x {1} c A x [0, 1]. Finally, the operator D" is induced by a vector 
bundle isomorphism in the neighborhood A x [0, 1/2) C A x [0, 1] on the cylinder. 

Remark 6.5. Inverse images like tt'D" are in general nonlocal operators. By 
way of illustration, consider the trivial covering 

dM =AUAU...UA — > A 

n copies 

of n copies of A. On 5M, we choose a trivial bundle E = C. Then 'k\E = C^; 
the direct image of a differential operator on the total space is always a diagonal 
operator 

thP = diag {P\^^ , Pj^J : {xxn — (X,C") , 
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whereas the inverse image of an operator on the base is a matrix operator of general 
form. Therefore, near the boundary we admit usual pseudodifferential operators 
as well as operators corresponding to transpositions of values of a function on 
the sheets of the covering. In a sense, admissible operators are obtained as an 
extension of the algebra of pseudodifferential operators by the nonlocal operators 
corresponding to elements of Am.tt- 

2. Symbols of admissible operators. One can readily define the symbol of 

an admissible operator and state the ellipticity condition. Namely, the symbol of 
an admissible operator T) is a pair of usual symbols, where 

(TM-P*ME\f^, — , pm-S*M — > M, 

is a symbol on the part of the manifold where the operator is pseudodifferential 
and 

ax ■■ P*x (7T!£^)Ux[0,i] — ^ P*X (^iCIxxfo.i] > Px ■ S*{X x [0, 1]) — yXx [0, 1], 

is a symbol on the cylinder X x [0, 1]. The symbols satisfy the compatibility con- 
dition 

('’■mIsm') - ^ X - 

An operator is said to be elliptic if both components of its symbol are invertible. 
An elliptic operator is Fredholm in appropriate Sobolev spaces. 

Summarizing, we see that admissible elliptic operators D on a Zn-manifold 
define absolute cycles 

[D] e K,{W). 

Let us show that the symbol of an elliptic admissible operator defines an element 
in K-theory. In other words, let us define an analog of the Atiyah-Singer difference 
construction for admissible elliptic operators. 

3. The difference construction for admissible operators. Let us cut M 

into two parts 

M' = M\ {dM X [0, 1)} and dM x [0, 1] . 

Then the symbol a {D) of an admissible elliptic operator D is naturally represented 
as a pair {cfm.cfx)- Each symbol in this pair has the corresponding difference 
element 

[aM] e {T*M') , [ax] € K° {T* {X x (0, 1])) . 

In the latter case, we use the difference construction for an absolute cycle with 
symbol ax of order zero. 

However, a single element of some topological A-group cannot be constructed 
from these data, since the manifolds T*M' and T* {X x (0,1]) cannot be glued 
smoothly (their boundaries may be nondiffeomorphic). Nevertheless, the pasting 
can be done if we glue the algebras of these manifolds rather than the manifolds 
themselves. 
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Let At*m, 7 v be the C*-algebra of the Z^-manifold It is the subal- 

gebra 

Ar^M,n c Co (T*M') 0 Co (T* {X x (0, 1]) , Endp*7T!l) , 
defined by the compatibility condition 

At-m,-k = {w©w I 

on the boundaries. 

The difference construction for admissible operators is a mapping 

(6.3) X : E11(M,7t) ^ Ko 

of the group Ell (M, tt) of stable homotopy classes of elliptic admissible operators 
on M into the Ko-group of the algebra 

Let us explicitly describe the element x [D] corresponding to an elliptic ad- 
missible operator 

D : (M, E) C^ (M, F) 

with symbol cr{D) = By stabilization, one can always assume that the 

bundle F is trivial: F = Now let us choose some embeddings of E and in 
trivial vector bundles and some projections 

Pe,Pc>‘ 

defining E and as 

£:~ImPEcC^©0, -ImPc*^ c 0©C^. 

Let FttiE, be the direct images of these projections in a neighborhood of the 
boundary. Clearly, these projections define the direct images of the corresponding 
subbundles. 

Then the difference construction of D is defined by the formula 
X [D] = [Pi 0 P 2 ] — [Pck 0 5 

where the projection Pi over T*M' is defined by 

(6.4) 

f PBCOs2|^| + Pc'‘Sin^lfl + ('T'm A:* +o-MCE)sin|^|cos|^|, |^| < 7 t/2, 

\ Pc^, I?I>7t/2 

(we assume that the symbol gm is homogeneous of order zero in the covariable ^), 
and the projection P 2 over T*(X x [0, 1]) is defined by one of the expressions 

Ptt.e cos^ If I + sin^ |f | + 1/2 + ctxPtvie) sin 2 |f | , 

P^,E ^ sin^ ^ + 1/2 + ctxPtt.e) sin 299 , 

-^TTlC^ • 

Here the first case is taken for the parameter values x' G X x [l/2,l],|f| < tt/ 2, 
the second case for x' e X x [0, 1/2] , |f | < nt, and the third expression applies to 
the remaining points. Here for brevity we write 

Ifl +7 t/ 2(1 -2t). 
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Remark 6.6. Geometrically, these projections define a subbundle that coin- 
cides over the zero section (i.e. for |^| = 0) with E C coincides for |^| > tt/2 

with the orthogonal subbundle C and is a rotation of one of the subbun- 

dles towards the other via the isomorphisms defined by the elliptic symbol a {D) 
at the intermediate points. 

Proposition 6.7. The difference construction (6.3) is a well-defined group 
isomorphism. 

Proof. The difference construction y preserves the equivalence relations on 
the groups Ell^ (M, tt) and K This can be proved by observing that a 

homotopy of operators gives a homotopy of symbols and hence a homotopy of the 
corresponding projections Pi 2 - Furthermore, y [D] is independent of the choice of 
embeddings in a trivial bundle, since all such embeddings are pairwise homotopic. 
The proof of the fact that x defines a one-to-one mapping can be obtained along 
the same lines. □ 

6.3. The Poincare isomorphism. Using the difference construction of the 
previous subsection, we define quantization mappings on Zn-manifolds: one for 
absolute cycles 

corresponding to the theory of admissible nonlocal operators, and another for 
relative cycles 

corresponding to the operators discussed in Section 3 and Subsection 6.1. 

Theorem 6.8. (The Poincare isomorphism.) The quantization mappings on 
Zn-manifolds are isomorphisms. 

Proof. 1) The algebra At*m,tt has the ideal 

I = Co {T* {X X (0,l)),Endp*7T!l) 
with quotient At*m,tv/I — Cq (T^'M) . Consider the exact sequence 
(6.5) ^ K, {T*X) ^ Ko (At-m,.) ^ K, (T*M) ^ K] (T*X) ^ 

of this pair. (To obtain this sequence, we use the natural isomorphisms 
K, {Co (LEndG)) ~ K, {Co {¥)) ~ K* (F) 
for a vector bundle G S Vect {¥).) Now consider the commutative diagram 
K*{T*X) K.,{AT-M,n) ^ Kl{T*M) K*+^{T*X) 

K,{X) ^ K,{M,dM) -> K.+i{X) 

The second row is the exact sequence of the pair X c in K-homology. The ver- 
tical arrows (except for the second) are Poincare isomorphisms on closed manifolds 
and manifolds with boundary. Thus, by the 5-lemma, the mapping 

K, {AT‘M,n) ^ K,{W) 
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is an isomorphism as well. 

2) The proof of the second isomorphism can be carried out in a similar way. 
In this case, the following diagram is relevant: 

^ K^{rX) ^ ^ K^{T*{M\dM)) ^ K^{T*X) ^ 

^ Ki{X) ^ ^ Ko{M) ^ Ko{X) ^ 

(Here the first row is the exact sequence of the pair R x T*X C T*M^ .) □ 

6.4. Poincare duality. 

1. Definition of the pairing. Let us now define Poincare-Lefschetz duality 
on Z^-manifolds following the same scheme as in the case of smooth manifolds. 
Since we have relative and absolute cycles, two dualities are expected: 



(6.6) 


ki{t*m"' 


) X Ki {Am,.) — >■ Z 


and 






(6.7) 


Ki {At-m, 


^) X K^{IT) — >Z. 



To save space, we consider only the first duality. The second can be considered in 
a similar way. 

Let us define the pairing (6.6) as follows: we act on the first argument by the 
Poincare isomorphism 

Q:K*,{Tm") {Am,.) 

and then apply the index pairing 

X* (^M,7t) X {Am,-k) — ^ ^ 
of i^-groups of opposite variance. 

Theorem 6.9. (Poincare duality.) [S SOI] On a Zn-manifold, the pairings 
(6.8) Ki (T^M") X Ki {Am,.) ^ Z, ^ = 0, 1, 

are nonsingular on the free parts of the groups. 

Proof. Fixing the first argument of the pairing, we obtain a mapping 
Ki(^^) ^ KI{Am,.) , 

where we write G' = Hom((7, Q). This mapping occurs in the commutative dia- 
gram 

Xl (T*X, Q) ^ X^^ (tW, Q) < — X^ {T*{M\dM) , Q) ^ X^ (T*X, Q) 

^ 1 . 

X^'{X) ^ X^{AM,n) ^ X^'{M) ^ X^'{X). 

All vertical arrows except for the second are isomorphisms (by Poincare duality 
on smooth manifolds). Thus, by the 5-lemma the remaining mapping is also an 
isomorphism. Hence, (6.8) is nondegenerate in the first factor. 
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The nondegeneracy in the second factor can be proved in a similar way. □ 

2. An application to spin"^- manifolds. Consider a pair (M, tt), where M 

has a spm^-structure induced over the boundary by a spm^-structure on the base 
X of the covering tt. Then the group K* is a free (M^) -module with 

one generator (where n — dimM). A generator is given by the difference element 

[ct(D)]gK”(T^") 

of the Dirac operator on M. (This can be proved by analogy with the case of closed 
manifolds; e.g., see [LM89].) Therefore, one can define the Poincare duality pairing 

using the composition Ac(T*M’^). It follows from Theorem 6.9 

that this pairing is nonsingular on the free parts of the groups. 

3. Computation of the pairing. Our aim is to find a computable formula 
for the Poincare duality pairing. To be definite, we consider only the case i = 0 in 
(6.6). To this end, we start from an explicit geometric realization of the groups. 
Let us first give a realization of the group Kq (AM, 7 r)* 

Lemma 6.10. The group Kq{Am,t:) 'is isomorphic to the group of stable ho- 
motopy classes of triples 

{E, F,(t), E,F e Vect (M) , : m E\g^ — » F\gj^ , 

where a is a vector bundle isomorphism. Here trivial triples are those induced by 
a global vector bundle isomorphism over M . 

Proof. This lemma is similar to Proposition 6.7: both give a topological 
realization of the Ao-group of the (7*-algebra of the Z„-manifolds. Hence, a triple 
(E',C^,a) (note that an arbitrary triple can be reduced to this form) defines the 
element 

[Pe © P 2 ] — [Pc^ © PniC^] ^ (•Am,7t) 

of the Ao-group, where the projection P 2 over X x [0, 1] is defined as 

A = AriECOS^VP + Ar.Cfc + (x) P„,ck +(T (x) , If = '^{1 -t) , 

and Pe and A* c are some projections on subbundles isomorphic to E 
and C^, respectively. One must also assume that these subbundles are mutually 
orthogonal. 

The proof of the fact that this construction gives a well-defined isomorphism 
with Kq [Am.-k] can be carried out by analogy with the proof of Proposition 6.7. 

□ 



This realization enables one to define the product 



K°{T*M") X Ko {Am,.) ^ Kq {At-m,.) 
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geometrically in terms of operators with coefficients in vector bundles. More pre- 
cisely, for two elements 

[a]eK°{Tm''), and [E , F, a'] e Ko {Am ,.) 

we consider the symbol 

(6.9) (7 0 1^; 0 (g) li? 

on M. The direct image of the restriction of this symbol to the boundary is 

7T! ((T ® 1e ® (T-1 ® = 7r,(T 0 1^, ® 7r,<7-^ 0 1„, 

~ (7r,a®7r,(T-i)0l^,£;|^^. 

The last isomorphism is induced by the vector bundle isomorphism 



T' ^\dM — ^\dM • 

There is a standard homotopy of the symbol (ttict 0 0 1^, to the iden- 

tity: 



7r\a 0 
0 1 



COST sinr\ 0 

— sinr COST / lo 7T\a' 



cos r — sin r 
sin r cos r 



T € [0, 7t/2] • 



Therefore, we have constructed an extension of the symbol (6.9) to an elliptic 
symbol of some admissible operator on M. Finally, the desired product 

[a] X [E,F,a'] G Kq {At*m,tv) 

can be defined as the difference element of this symbol. One can prove that the 
pairing 

(6.10) {, ) : X Kq {AM,n) Ko (At^m,.) ^ Z 

defined as a composition of this product with the index mapping coincides with 
Poincare duality defined earlier. 



6.5. A topological index for Z^-manifolds. Clearly, definition (6.10) of 
duality in the previous subsection still contains one component defined analytically. 
This is the index mapping 

ind : Kq[At*m,tv) — ^ 

A topological formula for it was obtained in [SSOl]. Let us briefiy recall this result. 

We suppose that the following geometric condition is satisfied: there is a free 
action of a finite group G on dM by diffeomorphisms such that tt is the projection 
to the quotient space dMjG. 

Consider two pairs (M, tt) and (M',7 t'). 

Definition 6.11. An embedding f of the pair in (M',7 t') is an em- 

bedding of manifolds with boundary such that f : M ^ M', / (dM) C dM' and 
the restriction of / to the boundary is a G-equivariant mapping. 
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An embedding induces the direct image mapping 
f\ : K^{At*m,tt) — ^ 

of the A-groups. 

For these -manifolds, one can give a universal space in which an arbitrary 
Zn -manifold can be embedded, the embedding being unique up to homotopy. To 
this end, by ttn • EGn — ^ BGn we denote the A^-universal bundle for the group 
G such that the spaces EGn and BGn are smooth compact manifolds without 
boundary. (For the existence of such models, e.g., see [LM98].) 

Proposition 6.12. For a sufficiently large N, there exists an embedding f of 
(M, 7t) in {EGn x [0,oo),7Tiv) • The embedding is unique up to homotopy. 

Sketch of Proof. By the A/’-universality of the covering tt^v, there exists 
an equivariant mapping dM EGn- If the dimension of the space EGn Is suffi- 
ciently large, then a general position argument shows that slightly deforming this 
mapping one obtains a smooth embedding. Then, by virtue of the A-connectedness 
of EGn, this extends to a mapping M EGn- In turn, by a small deformation 
outside the boundary 5M, this mapping can be made an embedding globally. □ 

The index theorem can be stated with the use of an embedding in the uni- 
versal space. To this end, we introduce the K-group of the (infinite-dimensional) 
classifying space for Zn-manifolds as the direct limit 

(6.11) E^{At*egx[0,oo),ttoo) — fini {At* eGn x [q ,Oo),7rAT ) 

of the A-groups corresponding to the filtration of EG by skeletons. 

Theorem 6.13. [SSOl] The even K -group of the classifying space is isomor- 
phic to Z, and the index can be computed in terms of the direct image mapping: 

indD = 

f'W(D)] e Ko{At- EGx[0,oo),ttoo) — 

References 

[Agr94] M. S. Agranovich, Elliptic operators on closed manifolds, In Partial differential equa- 
tions. VI, volume 63 of Encycl. Math. Sci., pp. 1-130, 1994. 

[Ati61] M. F. Atiyah, Characters and cohomology of finite groups, Publ. Math. IHES 9 (1961), 
23-64. 

[Ati69] , Global theory of elliptic operators, In Proc. of the Int. Symposium on Func- 

tional Analysis, pp. 21-30, Tokyo, 1969. University of Tokyo Press. 

[Ati89] , JY-Theory, The Advanced Book Program. Addison- Wesley, Inc., second edi- 

tion, 1989. 

[AB64] M. F. Atiyah and R. Bott, The index problem for manifolds with boundary, In Bombay 
Colloquium on Differential Analysis, pp. 175-186, Oxford, 1964. Oxford University 
Press. 

[ABP73] M. F. Atiyah, R. Bott, and V. K. Patodi, On the heat equation and the index theorem. 
Invent. Math. 19 (1973), 279-330. 




236 



ANTON SAVIN AND BORIS STERNIN 



[ADS83] M. F. Atiyah, H. Donnelly, and I. M. Singer, Eta invariants, signature defects of cusps 
and values of L- functions, Annals Math. 118 (1983), 131-177. 

[APS75] M. Atiyah, V. Patodi, and I. Singer, Spectral asymmetry and Riemannian geometry 
I, Math. Proc. Cambridge Philos. Soc. 77 (1975), 43-69. 

[APS76b] , Spectral asymmetry and Riemannian geometry II, Math. Proc. Cambridge 

Philos. Soc. 78 (1976), 405-432. 

[APS76a] , Spectral asymmetry and Riemannian geometry III, Math. Proc. Cambridge 

Philos. Soc. 79 (1976), 71-99. 

[AS63] M. F. Atiyah and I. M. Singer, The index of elliptic operators on compact manifolds. 
Bull. Amer. Math. Soc. 69 (1963), 422-433. 

[AS68] , The index of elliptic operators I, Ann. of Math. 87 (1968), 484-530. 

[BD82] P. Baum and R. G. Douglas, Toeplitz operators and Poincare duality. In Toeplitz 
Centennial, volume 4 of Operator Theory, Adv. AppL, pp. 137-166, Toeplitz Mem. 
Conf. Tel Aviv 1981, 1982. 

[BDT89] P. Baum, R. G. Douglas, and M. E. Taylor, Cycles and relative cycles in analytic 
K -homology, J. Differ. Geom. 30 (1989), no. 3, 761-804. 

[Bla98] B. Blackadar, /("-Theory for Operator Algebras, Number 5 in Mathematical Sciences 
Research Institute Publications, Cambridge University Press, 1998. Second edition. 

[BBW93] B. Boofi-Bavnbek and K. Wojciechowski, Elliptic Boundary Problems for Dirac Oper- 
ators, Birkhauser, Boston-Basel-Berlin, 1993. 

[BT82] R. Bott and L. Tu, Differential Forms in Algebraic Topology, volume 82 of Graduate 
Texts in Mathematics, Springer- Verlag, Berlin-Heidelberg— New York, 1982. 

[Bot92] B. Botvinnik, Manifolds with singularities and the Adams-Novikov spectral sequence, 
volume 170 of London Mathematical Society Lecture Note Series, Cambridge Univer- 
sity Press, Cambridge, 1992. 

[BdM71] L. Boutet de Monvel, Boundary problems for pseudodifferential operators, Acta Math. 
126 (1971), 11-51. 

[BDF77] L. Brown, R. Douglas, and P. Fillmore, Extensions of C* -algebras and K -homology, 
Ann. Math. II 105 (1977), 265-324. 

[BN94] J.-L. Brylinski and V. Nistor, Cyclic cohomology of etale groupoids, /("-theory 8 (1994), 

341-365. 

[Con94] A. Connes, Noncommutative geometry. Academic Press Inc., San Diego, CA, 1994. 

[DZ98] X. Dai and W. Zhang, Higher spectral flow, J. Funct. Anal. 157 (1998), no. 2, 432-469. 

[Don78] H. Donnelly, Eta-invariants for G -spaces, Indiana Univ. Math. J. 27 (1978), 889-918. 

[FM92] D. Freed and R. Melrose, A mod k index theorem. Invent. Math. 107 (1992), no. 2, 
283-299. 

[Gil81] P. B. Gilkey, The residue of the global eta function at the origin, Adv. in Math. 40 
(1981), 290-307. 

[Gil89a] , The geometry of spherical space form groups. In Series in Pure Mathematics, 

volume 7, Singapore, 1989, World Sientific Publ. Co. Pte. Ltd. 

[Gil89b] , The eta invariant of even order operators. Lecture Notes in Mathematics, 

vol. 1410, pp. 202-211, 1989. 

[Gil95] , Invariance theory, the heat equation, and the Atiyah-Singer index theorem, 

Studies in Advanced Mathematics. CRC Press, Boca Raton, FL, second edition, 1995. 

[GS95] G. Grubb and R. Seeley, Weakly parametric pseudodifferential operators and Atiyah- 
Patodi-Singer boundary problems. Invent. Math. 121 (1995), 481-529. 

[HROO] N. Higson and J. Roe, Analytic /("-homology, Oxford University Press, Oxford, 2000. 

[Hir73] F. Hirzebruch, Hilbert modular surfaces, Enseignement Math. 19 (1973), 183-281. 

[Hor85] L. Hdrmander, The Analysis of Linear Partial Differential Operators. Ill, Springer- 
Verlag, Berlin-Heidelberg-New York- Tokyo, 1985. 

[Kcis73] G. G. Kasparov, The generalized index of elliptic operators, Funct. Anal. Appl. 7 
(1973), 238-240. 




[Kas88] 

[LM02] 

[LM89] 

[Les97] 

[LM98] 

[Mel93] 

[Mel95] 

[MN96] 

[MP92] 

[MP97] 

[Miil84] 

[NSS99] 

[NSSS98] 

[Pal65] 

[Phi96] 

[RS82] 

[Sal95] 

[Sav99] 

[SSS99a] 

[SSS99b] 

[SSSOl] 

[SS99] 



INDEX DEFECTS IN THE THEORY OF SPECTRAL PROBLEMS 237 



, Equivariant KK-theory and the Novikov conjecture^ Invent. Math. 91 (1988), 

no. 1, 147-201. 

R. Lauter and S. Moroianu, The index of cusp operators on manifolds with comers, 
Ann. Global Anal. Geom. 21 (2002), no. 1, 31-49. 

H. B. Lawson and M. L. Michelsohn, Spin geometry, Princeton Univ. Press, Princeton, 
1989. 

M. Lesch, Differential Operators of Fuchs Type, Gonical Singularities, and Asymp- 
totic Methods, volume 136 of Teuhner-Texte zur Mathematik, B. G. Teubner Verlag, 
Stuttgart-Leipzig, 1997. 

G. Luke and A. S. Mishchenko, Vector bundles and their applications, volume 447 of 
Mathematics and its Applications, Kluwer Academic Publishers, Dordrecht, 1998. 

R. Melrose, The Atiyah-Patodi-Singer Index Theorem, Research Notes in Mathemat- 
ics, A. K. Peters, Boston, 1993. 

, The eta invariant and families of pseudodifferential operators. Math. Re- 
search Letters 2 (1995), no. 5, 541-561. 

R. Melrose and V. Nistor, Homology of pseudodifferential operators I. Manifolds with 
boundary. Preprint, 1996. 

R. Melrose and P. Piazza, Analytic K -theory on manifolds with comers, Adv. in Math. 
92 (1992), no. 1, 1-26. 

, Families of Dirac operators, boundaries and the b-calculus, J. of Diff. Geom- 
etry 46 (1997), no. 1, 99-180. 

W. Muller, Signature defects of cusps of Hilbert modular varieties and values of L- 
series at s = 1, j. Diff. Geometry 20 (1984), 55-119. 

V. Nazaikinskii, B.-W. Schulze, and B. Sternin, On the Homotopy Glassification of 
Elliptic Operators on Manifolds with Singularities, Univ. Potsdam, Institut fiir Math- 
ematik, Potsdam, Oktober 1999, Preprint no. 99/21. 

V. Nazaikinskii, B.-W. Schulze, B. Sternin, and V. Shatalov, Spectral boundary value 
problems and elliptic equations on singular manifolds, Differents. Uravnenija 34 
(1998), no. 5, 695-708, English transL: Differential Equations 34 (1998), no. 5, 696- 
710. 

R. S. Palais, Seminar on the Atiyah-Singer index theorem, Princeton Univ. Press, 
Princeton, NJ, 1965. 

J. Phillips, Self-adjoint Fredholm operators and spectral flow, Canad. Math. Bull. 39 
(1996), no. 4, 460-467. 

S. Rempel and B.-W. Schulze, Index Theory of Elliptic Boundary Problems, 
Akademie- Verlag, Berlin, 1982. 

D. Salamon, The spectral flow and the Maslov index. Bull. LMS 27 (1995), no. 1, 1-33. 
A. Yu. Savin, On operators that allow the decomposition of index formulas for spectral 
boundary value problems, Doklady Mathematics 60 (1999), no. 2, 220-222. 

A. Savin, B.-W. Schulze, and B. Sternin, On invariant index formulas for spectral 
boundary value problems, Differentsial’nye uravnenija 35 (1999), no. 5, 709-718. 

, The Homotopy Classification and the Index of Boundary Value Problems for 

General Elliptic Operators, Univ. Potsdam, Institut fiir Mathematik, October 1999, 
Preprint no. 99/20, arXiv: math/9911055. 

, On the homotopy classification of elliptic boundary value problems, In Par- 
tial differential equations and spectral theory: PDE 2000 Conference in Clausthal, 
Germany, volume 126 of Operator theory: advances and applications, pp. 299-306, 
Birkhauser Basel-Boston-Berlin, 2001. 

A. Yu. Savin and B. Yu. Sternin, Elliptic operators in even subspaces, Matem. sbornik 
190 (1999), no. 8, 125-160, English transl.: Sbornik: Mathematics 190 (1999), no. 8, 
1195-1228, arXiv: math/9907027. 




238 



ANTON SAVIN AND BORIS STERNIN 



[SSOO] , Elliptic operators in odd subspaces, Matem. sbornik 191 (2000), no. 8 , 89-112, 

English transL: Sbornik: Mathematics 191 (2000), no. 8 , arXiv: math/9907039. 

[SSOl] , Index Defects in the Theory of Nonlocal Boundary Value Problems and 

the 77 -Invariant, Univ. Potsdam, Institut fiir Mathematik, Potsdam, November 2001, 
Preprint no. 01/31, arXiv: math/0108107. 

[SS02] , The eta-invariant and Pontryagin duality in K -theory, Math. Notes 71 

(2002), no. 2, 245-261, arXiv: math/0006046. 

[SS03] , The eta invariant and parity conditions, Adv. in Math. (2003), 

(to appear), preliminary version at http://www.math.uni-potsdam.de/a_partdiff/ 
prepr/ 2000_21 .zip. 

[Sch91] B.-W. Schulze, Pseudodifferential Operators on Manifolds with Singularities, North- 

Holland, Amsterdam, 1991. 

[SSS98] B.-W. Schulze, B. Sternin, and V. Shatalov, On general boundary value problems for 

elliptic equations. Math. Sb. 189 (1998), no. 10, 145-160, English transL: Sbornik: 
Mathematics 189 (1998), no. 10, 1573-1586. 

[See67] R. T. Seeley, Complex powers of an elliptic operator, Proc. Sympos. Pure Math. 10 
(1967), 288-307. 

[Sul70] D. Sullivan, Geometric Topology. Localization, Periodicity and Galois Symmetry, MIT, 
Cambridge, Massachusets, 1970. 

Independent University of Moscow, Moscow 121002, Bolshoi Vlasevsky Pereulok, 

Dom 11, Russia 

E-mail address: antonsavin@mtu-net.ru 

Independent University of Moscow, Moscow 121002, Bolshoi Vlasevsky Pereulok, 

Dom 11, Russia 

E-mail address: sternin@mail.ru 




Operator Theory: 

Advances and Applications, Vol. 151, 239-264 
© 2004 Birkhauser Verlag, Basel/Switzerland 



Cyclic homology and pseudodifFerential operators, a survey 

Moulay-Tahar Benameur, Jacek Brodzki, and Victor Nistor 



Abstract. We present a brief introduction to Hochschild and cyclic homol- 
ogy designed for researchers interested in pseudodifferential operators and 
their applications to index theory, spectral invariants, and asymptotics. 



Introduction 

Singular cohomology is often used in Algebraic Topology to obtain invariants 
of topological spaces. In the same spirit, Hochschild and cyclic homology often 
provide interesting invariants of algebras. A possible important application of these 
algebra invariants is the study of spaces with additional structures; these include, 
for instance, spaces with singularities or spaces endowed with group actions. 

This paper is a rapid survey of Hochschild and cyclic homology, designed for 
mathematicians and physicists interested in pseudodifferential operators and their 
applications to index theory, spectral invariants, and asymptotics. We assume only 
very little familiarity with the subject, including homological algebra. Moreover, 
we have also included some short proofs when we felt that they are particularly 
helpful to the reader. 

Hochschild homology is usually thought of as a generalization of the notion of 
differential forms and (periodic) cyclic homology as a generalization of (de Rham) 
cohomology, from smooth compact manifolds to essentially arbitrary algebras . The 
main guiding principle of this development is the correspondence 

“Space” ^ “Algebra of functions on that space”, 

which is at the heart of non-commutative geometry [5, 20, 21, 31, 34, 37, 38, 
42, 43, 44]. This principle had been used before in Algebraic Geometry where 
this becomes the correspondence (contravariant equivalence of categories) between 
affine algebraic varieties over a field t and commutative, reduced, finitely generated 
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algebras over 1^. In Functional Analysis this principle is illustrated by the Gelfand- 
Naimark equivalence between the categories of compact topological spaces and 
of commutative, unital C^-algebras. One of the main ideas of non-commutative 
geometry is that this correspondence somehow extends also to (classes of) non- 
commutative algebras. The theory of Quantum groups [ 39 , 42 ] is a truly remark- 
able example of how this principle works in practice. Another remarkable example 
is that the singular cohomology of spaces and the long exact cohomology sequences 
of pairs of spaces extend to algebras - this is the Excision theorem in periodic cyclic 
homology [ 23 ]. 

Our main example of how this principle works in practice will be centered 
upon algebras like C^{M) and where M is a smooth compact manifold 

and 4^^ (M) denotes the algebra of classical pseudodifferential operators of integral 
order on M . We shall see that the Hochschild homology of C^{M) can be identified 
with the space of differential forms on M, whereas the periodic cyclic homology of 
C^{M) is the same as the de Rham cohomology of M. The results on C^{M) are 
interesting not only on their own, but also because they lead to a calculation of the 
Hochschild, cyclic, and periodic cyclic homology of algebras of pseudodifferential 
operators. 

The contents of the paper are as follows. In Section 1, we define Hochschild 
homology and give some elementary properties and concrete computations. In 
Section 2, we introduce the cyclic homology and the Connes-Karoubi Chern char- 
acter. We also recall the Cuntz-Quillen Excision theorem together with an abstract 
cyclic cohomological index theorem. In Section 3, we extend our homologies and 
the complexes defining them to the setting of Frechet algebras and discover, in par- 
ticular, that when dealing with topological algebras, choice of a suitable topological 
tensor product becomes important. Section 4 deals with algebras of complete pseu- 
dodifferential symbols on groupoids with corners. There, we give the computation 
of periodic cyclic homology and Hochschild homology for such algebras. Finally, 
Section 5 applies these results to some geometric examples in non-commutative 
geometry. In particular, it relates Hochschild homology computations with local 
residues. No results in this paper are new. 

We have not attempted to provide a comprehensive list of references, restrict- 
ing instead to the sources most relevant to the results presented here. The main 
sources of general information on cyclic type homology theories are the books 
[ 9 , 21 , 31 , 37 ], which contain detailed bibliographic information. 

We thank the referee for carefully reading our manuscript and for making 
several useful suggestions. 



1. Hochschild homology 

We begin by recalling the definitions of Hochschild homology groups of an 
algebra A, which we shall assume to be defined over the field of complex numbers. 
Later, we shall treat the case of algebras equipped with topology. 
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Let A be an algebra, not necessarily with unit. A trace on A is a linear map 
T : A C such that 

r(aoai — aiao) = 0 

for all ao,ai G A. This definition captures an important property of the usual 
matrix trace Tr, defined on the algebra A = Mn(C) by Tr{[aij\) — ^au. The 
space of all traces on A is denoted HH^(A), and is also called the 0th Hochschild 
cohomology group, for reasons that we explain now. 

We shall need two differential complexes associated with the algebra A, de- 
noted H{A) and 'H'(A), The space of n-chains for both will be the n + 1-fold tensor 
product of A by itself. The two complexes are equipped with differentials b' and b 
defined as follows: 

n — 1 

6'(ao ^ ai ^ ^ On) — ^(-l)^ao a^ai^l 0 ... 0 a^, 

(^•^) z=0 

b{ao 0 ai 0 ... 0 On) = b'{ao 0 0 ... 0 On) + (-l)^anao 0 • • • 0 ctn-i, 

where uq, ai, . . . , Un G A. Thus b and b' define linear maps 

b, b' : A®^+^ -> A^^. 

By definition, Hochschild homology groups of the algebra A, denoted HHn(A), 
are the homology groups of the complex 

(1.2) n{A) := (A^^+\6). 

By contrast, the complex 

(1.3) n'{A) := (A®"+\6') 

is often acyclic. This happens, for example when A has a unit, because 
s(ao 0 ai 0 ... 0 On) = 1 0 ao 0 tti 0 . . . 0 ttn 
is a homotopy between 0 and the identity: 

b's + sb' = 1. 

In this case the complex H'{A) is a resolution of A by free A-bimodules. It has 
been noted by Wodzicki [61] that nonunital algebras whose 'H'(A) complex is 
acyclic have useful properties. Algebras with this property are now called H-unital 
(homologically unital). 

The cohomology groups of the dual complex 

n*{A) := (Hom(A^^+\C),6*) 

are called the Hochschild cohomology groups of A and denoted HH”(A). Since r 
is a trace if, and only if, r o 6 = 0, we obtain that HH°(A) is indeed the space of 
traces on A. 

Clearly the groups HHn(A) are covariant functors in A, in the sense that any 
algebra morphism (f) : A ^ B induces a morphism 

: HHn(A) HH,(B) 
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for any integer n > 0, Similarly, we also obtain a morphism 0* : ^ 

In other words, Hochschild cohomology is a contravariant functor. It is 
interesting to note that if Z is the center of A, then HHn(>A) is also a Z-module, 
where, at the level of complexes the action is given by 

(1.4) z{aQ 0 tti (g) . . . (g) an) — zao (g) ai (g) . . . (g) a^. 

for all 2 ; G Z. As z is in the center of A, this action will commute with the 
Hochschild differential b. 

When computing the Hochschild homology of an algebra A, it is often useful 
to replace the original complex 'H(A) with an equivalent complex. This can be 
achieved, for example, using the next Proposition, which is a standard result from 
homological algebra (see [40, 41], for instance). Before we can state that propo- 
sition, we need to recall the following terminology. An A-bimodule is an abelian 
group M which is at the same time a left- and right- A- module. A free A-bimodule 
is one of the form A® V 0 A, where P is a vector space and 

ao(c^o ^ ^ ^ CLi)ai = (^o^^o) ^ ^ ^ («i«i)- 

Let / : A(g)Vi(8)A A(g)Vo(8)Abea morphism of free bimodules, and assume that 
/(I (g) u (8) 1) = ^ak^Wk^a'j^. We shall denote by / (8) 1 the map A 8 Vi A 8 Vo 
defined by 

(/ 8 l)(a 8 u) = ^ a'j^aak 8 Wk 

Let A^PP be A as a vector space but with multiplication ★ given by a ★a' a'a. 
Let A^ := A 8 A^^^. The reader familiar with balanced tensor products will note 
that the above construction amount to taking the tensor product — 8 a^ A of / 
and the respective free modules. (Note that a free A-bimodule is the same thing 
as a free A®-module.) 

Proposition 1.1. Let A be a unital algebra and 

A®Vo®At^ A®Vi®Ai^ ... 

be an exact complex of A-bimodules. Then the homology groups of the complex 

A 8 Vo ^ — A 8 Vi < — . . . 

are naturally isomorphic to the groups HHn(A). 

For example, when A is unital,^ the complex H'{A) is exact, and when we apply 
to it the above proposition we obtain the Hochschild complex H{A). Another useful 
corollary of this proposition is derived when we use the exactness of the localization 
functor. The following result is due to Brylinski [14]. 

Proposition 1.2. Let S be a multiplicative subset of the center Z of the 
algebra A. Then HH*(^-iA) ^ S~^ HH^A). 



^we assumed A unital in the definition of / (g) 1 
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Let us use now Proposition 1.1 to determine the Hochschild homology of the 
algebra 0[C^] := C[Xi,...,Xn] of polynomials in n- variables. We first need to 
recall the algebraic de Rham complex. Let W* be the complex vector space gen- 
erated by the 1-forms dXi , . . . , dX^- 

W* = CdXi 0 ... 0 CdXn 



We define the space of q-forms on to be O^(C^) = 0[C'^] 0 A^W*. Here is 
of course regarded as an affine algebraic variety. Then the de Rham differential 



is defined by 

d(^PdXi, . . . dXi^) = {§^^dXi + . . . + ^dXn)dXi, . . . dXi^. 

(We omitted the A in the products above.) We can now define the Hochschild- 
Kostant- Rosenberg- Cannes map (HKRC-map) 



A = 0[C^] = C[Xi, . . . , Xn], by the formula 



(1.5) 



x{ao 0 . . . 0 ttg) = —aodai . . . doq 



Proposition 1.3. 
X*:HH,(^)-^Q^C-). 



We have x o 6 = 0 and hence x defines an isomorphism 



The proof of this proposition is a paradigm for the computation of the Hoch- 
schild homology of commutative algebras, so we present it in detail. 



Proof. Our main tool will be the Koszul complex, which provides a general 
recipe for building resolutions oi A = 0[C'^]. We construct it as follows. We fix 
the sequence (vi,V 2 , . . . ,Vn), vj = Xj ^ 1 — 1 <S> Xj of elements of A 0 X. (This 
is a regular sequence^ see [ 27 ] for the definition). Let V be the vector space with 
basis the elements Vj of this regular sequence. Also, let /Cg = A 0 0 A. The 

spaces Xq will form the Koszul complex relative to the sequence (t’l, . . . , l>^). The 
differentials of the Koszul complex are given by the following formula 



S{a(^Vi^ A . . . A Vi^ 0 a') := ^(-1)-^ ^ A ... A A ... A 0 a' 

— a ® Vi^ A ... A v^. A ... A Vi^ ^ X^^ a'j 

where v means that the symbol v is to be omitted. 

The Koszul complex /C provides a resolution of A by free A 0 A-modules 
(this follows from the fact that the sequence Vj is regular). In other words, the 
complex X has vanishing homology, except in dimension zero, where its homology 
is isomorphic to A via the multiplication map 

/Co = A0A3a0a'^ aa G A . 
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Let w = A . . . AVi^ G A^V. Define f : 1C 1~C[A) := 6 ') by 

f{a^w^ a') := ^ sign((j)a 0 0 0 ... 0 0 a', 

aeSq 

where the sum is taken over the symmetric group on q letters and sign((j) denotes 
the sign of the permutation a. The map / is a chain map, which means that it 
commutes with the differentials: 

fs = b'f, 

and hence it induces a morphism of complexes (or, in this case, resolutions). The 
morphism / is the identity on /Co = A ^ A ^o(^) hence it induces the 
identity on the homology groups in dimension zero, that is, on the algebra A. 
(This is a standard homological fact that can easily be proved as an exercise.) 
Using the remark just before Proposition 1.1 we see that the map 

/ 0 1 : /C 0^e A n'{A) 0^e A ^ n{A) 

will also induce an isomorphism in homology. 

The result then follows because (50l = 0 and x^/ is the identity, if we identify 

VwithW*hyVj-^dXj. □ 

The same argument can be used to prove the following result (see [ 29 , 38 ]). 

Theorem 1.4. Let Y he a smooth, complex algebraic variety and 0[Y] be the 
ring of regular functions on Y and Ct^{Y) be the space of algebraic q~forms on Y . 
Then the HKRC map \ induces isomorphisms 

X : HH,(o[y]) n«(y) 

for all q >0. 

Another important class of examples deals with algebras associated with groups. 
The simplest situation is probably the following. Let L be a group (we do not 
assume that T has topology) and let C[r] be the group algebra of P. By definition, 
C[r] is the space of finite linear combinations a^ 7 , 7 € P, E C equipped 
with the product (a 7 )(a' 7 ') := aa'( 77 '). For any 7 G P we denote by 

D := {9 € r,p7 = 7ff}, 

the centralizer of 7 . Let H^(P^) be the ^th homology group of P^ with complex 
coefficients (it is the homology with complex coefficients of any CW-complex whose 
fundamental group is P^ and all other homotopy groups vanish). Let (P) denote 
the set of conjugacy classes of P and ( 7 ) denote the conjugacy class of 7 G P. Then 
[ 17 ]: 

Theorem 1.5. Let V be a discrete group. Then 

HH,(C[r])c. 0 H,(r,). 

(7)e(r) 
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In the above sum, we take exactly one 7 from each conjugacy class of T. Also, 
note that the groups Hg(ra^) and Hg(ry) are canonically isomorphic if x and y are 
conjugate in F. 

These results extend to crossed products. See for example [16, 18] for the cal- 
culation of the Hochschild, cyclic, and periodic cyclic homology of crossed product 
algebras of the form C^{M) x F, where F is a discrete group acting on M by 
diffeomorphisms. Also, see [3] for some applications of these results to or bifold 
cohomology as well as [24, 51] for results on general crossed products A x F, with 
A not necessarily commutative. (When [51] was being written, the paper [24] was 
not available in Romanian libraries, which explains the overlap in results between 
the two papers.) 

Hochschild homology is also compatible with completions, in the following 
sense. Let A be a finitely generated module over its center t and let M denote 
the completion of a ^-module M with respect to the topology defined by an ideal 
let, then we have [33] 

Theorem 1.6. Denote by HHg°^(A) the homology of the completion of the 
Hochschild complex of A with respect to the natural filtration defined by I^A. Then 

HH*/^^(A) - HH,(A). 



2. Cyclic homology 

We now define cyclic homology, which, £is wais the case with Hochschild ho- 
mology, will appear as the homology of an explicitly defined differential complex. 
The cyclic complex will be introduced as the total complex of a double complex 
constructed using the Hochschild complex Ti{A), together with a new differential 
B whose definition uses in a crucial way the action of a cyclic group of a suitable 
size. 

Let us assume first that A is a unital algebra. We shall denote by t the (signed) 
generator of cyclic permutations: 

(2.1) t(ciQ a\ a^i^ — ( 1) Oji Uq a^i — \ 

Using this operator and the contracting homotopy s of the complex H'(A) we 
construct the operator B of degree +1 in two steps. First define 

n 

(2.2) Bo{ao (8) ai 0 ... 0 an) = s'^^t^{ao 0 ai 0 ... 0 a^) 

k=0 

and then put B = {l—t)Bo. Then H is a differential, B^ = 0 and it anticommutes 
with the Hochschild differential b: [b, B]^ bB -\- Bb = 0. 

We have thus defined a double complex which fills up an octant in the plane, 
see Figure 1. Note that columns in this complex are copies of the Hochschild 
complex Ti{A). The cyclic complex C{A) is by definition the total complex of this 
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^03 

b 

^02 



B 



B 



^02 



Figure 1. The cyclic bicomplex of the algebra A. 



double complex. Thus the space of cyclic n-chains is defined by 

( 2 . 3 ) C{A)n = ^^'Hn-2k{A), 

k>0 

we see that {C{A),b + 5), is a complex, called the cyclic complex of A^ whose 
homology is by definition the cyclic homology of A (see [20, 31, 60]). 

There is a canonical operator S : Cn(A) Cn- 2 {A), called the Connes peri- 
odicity operator, which shifts the cyclic complex down by two degrees, and which 
is defined by S{uJn,<jJn- 2 ^^n- 4 :^ . . . ) (o;^_ 2 ,a;n- 4 , . . . ), where LOi e 7ii{A), This 

operator induces the short exact sequence of complexes 

0 n(A) 4 C{A) 4 C{A)[ 2 ] 0 , 

where the map I is the inclusion of the Hochschild complex as the first column 
of the cyclic complex and where on the right the cyclic complex has been shifted 
by two degrees. Applying the homology functor to this sequence we obtain the 
following exact sequence of Connes and Tsygan: 

(2.4) . . . -4 HC„(^) 4^ ECn-2(A) -4 

where B is the differential defined above, see [20, 38] for more details. Anticipating 
a little bit, this exact sequence exists whether or not A is endowed with a topology. 
The periodic cyclic complex of an algebra A is the complex 

C^^\A) := limC(A), 



the inverse limit being taken with respect to the periodicity morphism S. It is a 
Z/2Z-graded complex, whose chains are (possibly infinite) sequences of Hochschild 
chains with degrees of the same parity. 

More generally, cyclic homology groups can be defined for “mixed complexes,” 
[32]. A mixed complex (T, b, B) is a Z+-graded complex vector space X = {Xn)n>o 
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endowed with two differentials b and b : ^n-i and B : d:"nYi, 

satisfying 

b^ =B‘^ = bB-^Bb = 0. 

The cyclic complex^ ^(X), eissociated to a mixed complex (X, 6, B) is the complex 

^n(d^) = Xn & Xn-2 0 d:"n-4 • • • = Xn-2k 

k 

with differential bX B. It is the total complex associated to the bicomplex shown 
in Figure 2. The cyclic homology groups of the mixed complex X are the homology 
groups of the cyclic complex of X, 

}lCr^{X)=Rr^{C{X),b+B). 




Figure 2. The bicomplex associated with a mixed complex. 

We review below a few necessary results on mixed complexes. The interested 
reader can find more information in [30]. 

The homology of the complex (Xn , b) is called the Hochschild homology of 
the mixed complex (X, 6, B) and is denoted HH*(A'). If A is an algebra with unit 
and if we let X^ = with the differentials b and B defined above, then 

we recover the usual definitions of the Hochschild and cyclic homology groups 
of A. If ^ is an arbitrary algebra, denote by A~^ = ^ + C the algebra with an 
adjoined unit and let Xn(A) = ker{Xn{A'^) — > A'„(C)). The cyclic and Hochschild 
homology groups of the resulting mixed complex {Xn{A)^b, B) are, by definition, 
the cyclic and Hochschild homology groups of the not necessarily unital algebra 
A, When ^ is a unital algebra, the two ways of defining Hochschild and cyclic 
homology groups agree. Cyclic and Hochschild homology are covariant functors on 
the category of mixed complexes: a morphism f : A ^ B of algebras induces a 
morphism of the corresponding mixed complexes and hence it induces morphisms 
/, : B.C4A) BC,{B) and /, : HH,(A) ^ HH,(H). 

The cyclic complex of a mixed complex (X,b,B) has a periodicity endomor- 
phism 5 : Cn{X) Cn- 2 {X) which maps Xn to 0 and is the identity on the other 
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factors, as was seen in the case of the cyclic complex C{A). This defines a map 
HCn(A') — also denoted by S. The homology groups HPi(A') of the 
projective limit complex 

(2.5) cr(^) 

with respect to the periodicity operator S are called the periodic cyclic homology 
groups of A!: 

(2.6) HPi(A’) = Hi(Cr(A^))- 

Periodic cyclic homology is a Z/2Z-graded homology theory, HP^ = HPj_^ 2 - Stan- 
dard homological algebra shows that cyclic and periodic cyclic homology fit into 
the following lim^ exact sequence 

(2.7) 0 — > lim^ RCm^i{X) — > HP^(A') — > lim HC^(A') — > 0. 

We shall write HP^(^) for the periodic cyclic homology of the (mixed complex 
associated to the) algebra A. Again, functorial properties of mixed complexes show 
that the periodic cyclic homology of an algebra is a covariant functor. 

Cyclic cohomology and periodic cyclic cohomology are defined by duality and, 
in case there is no topology, they are the duals of the corresponding homology 
groups. 

The following standard lemma is useful for many calculations. 

Lemma 2.1. Let f : X X' be a morphism of mixed complexes ( Le . commut- 
ing with b and B ) that induces an isomorphism of the Hochschild homology groups. 
Then f induces an isomorphism of the cyclic homology, periodic cyclic homology, 
Hochschild cohomology, cyclic cohomology, and periodic cyclic cohomology groups. 

Proof. Consider filt rat ions of the cyclic complexes associated to X and 
X' by the columns of the corresponding double complexes. These filtrations define 
convergent spectral sequences and / is an isomorphism of these spectral sequences. 
The standard comparison theorem for spectral sequences is now enough to prove 
the isomorphisms of the cyclic homology groups of X and X' , (Alternatively, one 
can use here the SBI-exact sequence.) For periodic cyclic homology, use also the 
lim^ exact sequence above relating cyclic and periodic cyclic homologies. 

The cohomology groups are dual (in this topology free setting) of the corre- 
sponding homology groups. □ 

Here is an application of this lemma. Consider 

Tr* : 7^,(M,v(^)) ^ H,(A), ^ G Z+, 

the map defined by Tr*(6o0. . .^bq) = Tr{momi . . . mq)ao^. . .<^Oq, if bk = ruk^ 
Ok G Miv(C) A = Mn{A). Also consider the (unital) inclusion t : A ^ Mn{A) 
and be the morphism induced on the Hochschild complexes. 

Proposition 2.2. The map Tr^ is a morphism of mixed complexes. Both 
and Tr^K induce isomorphisms on Hochschild, cyclic, and periodic cyclic homologies 
and cohomologies such that = N~^Tr^. 
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Proof. An easy calculation shows that Tr* is a morphism of mixed com- 
plexes. The map induces an isomorphism in Hochschild homology, by the Kiin- 
neth formula for Hochschild homology [37, 1.0.16, 1.2.4]. Thus induces an iso- 
morphism of cyclic and periodic cyclic homology as well. The equation Tr^i^ = N 
is immediate and gives the rest of the proposition. □ 

For commutative algebras, cyclic homology can be calculated using the Hoch- 
schild homology and the equation relating the de Rham differential 

dDR and the differential B via the HKRC map x- ^ algebra 

of regular functions on a smooth complex algebraic variety, as in the statement of 
Theorem 1.4. To compute HCg(A) and the other groups associated to A, we first 
notice that x defines a morphism 

of mixed complexes, which is an isomorphism on Hochschild homology, by the 
same theorem of Today and Quillen used above. This then gives the following. 

Theorem 2.3. Let Y he a smooth complex algebraic variety and Hg(T) he its 
singular homology groups with complex coefficients. If A = 0[Y], then 

T/2] 

KCg{A) ~ © 0 

with the periodicity morphism S identifying with the natural projection. In partic- 

Let us mention that the result on periodic cyclic homology of the above theo- 
rem extends to the case when Y is not necessarily smooth by a result of [25], but 
the proof is more difficult. (See [33] for a proof of this result in the spirit of this 
paper, using Theorem 1.6.) 

We shall use these calculations to construct Chern characters. By taking Y to 
be a point, we obtain that HC 2 g(C) ~ C and HC 2 q+i(C) ~ 0. We can take these 
isomorphisms to be compatible with the periodicity operator S and such that for 
g = 0 it reduces to 

HCo(C) = HHo(C) - C/[C,C] - C. 

We shall denote by Pq e HC 2 q(C) the unique element such that 

S% = leC = HCo(C). 

If e G Mn{A) is a projection, it will induce a (non-unital) morphism : 
C Mn{A) by a Ae. Then the Connes-Karouhi Chern character of e in cyclic 
homology [20, 31] is defined by 

(2.8) Chq{[e]) = Tr^Mriq)) e HC 2 g(A). 

This map can be shown to depend only on the class of e in iT- theory and to define 
a morphism 



Chq:Ko{A)-^RC2q{A). 
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One can define similarly the Chern character in periodic cyclic homology and 
the Chern character on K\ (algebraic K-theory). For the Connes-Karoubi Chern 
character on iCi, we use instead Y" = C*, whose algebra of regular functions is 
0\Y] ~ C[z,z~~^], the algebra of Laurent polynomials in 2 : and z~^ (this algebra, 
in turn, is isomorphic to the group algebra of Z). Then HCg((9[y']) ~ C, for any 
q > 1. We are interested in the odd groups, which will be generated by elements 
Vk G ¥LC 2 k+i{ 0 [Y])^ which can be chosen to satisfy vi = z~^(S>z and S^V 2 k+i = Vi- 

Then, if u G Mn{A) is an invertible element, it defines a morphism 'ip : 
C[C*] M]\j{A), The Connes-Karoubi Chern character of u in cyclic homology is 

thus defined by 

(2.9) Ch^{[u]) = Tr^iMvq)) e HC2,+i(^). 

Again, this map can be shown to depend only on the class of u in A-theory and 
to define a morphism 

Both the Chern character on Kq and on Ki are functorial, by construction. 

Cyclic homology behaves to a large extent like Hochschild homology. Periodic 
cyclic homology however has a few additional properties that often make it easier 
to compute. The most important among them is the excision property, which we 
state here, although we shall not need it in this paper. The proof of excision 
in periodic cyclic homology relies in a crucial way on the following theorem of 
Goodwillie. (see [26]). 

Theorem 2.4. If I c A is a nilpotent two-sided ideal, then the quotient 
morphism A Aj I induces an isomorphism HPh<(A) — ^ HP* (A//). 

A deep and far reaching consequence of Goodwillie’s theorem, and also of 
Wodzicki’s Excision theorem in Hochschild homology [61], is the Excision theorem 
in periodic cyclic homology established by Cuntz and Quillen [23]. 

Theorem 2.5. Any two-sided ideal J of an algebra A over a characteristic 0 
field gives rise to a periodic six-term exact sequence 



( 2 . 10 ) 



HPo(J) ^ HPo(A) ^ HPo(A/J) 



d 



d 



HPi(A/J) ^ HPi(A) ^ HPi(J). 



It is interesting to note that this theorem holds in much greater generality in 
periodic cyclic homology than, for instance, in cyclic homology, where one needs 
to assume that the ideal J is an iL-unital algebra. 

Excision in periodic cyclic homology is compatible with excision in A- theory, 
which is seen from the following result [53]. 
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Theorem 2.6. Let I C A the a two-sided ideal of a complex algebra A. Then 
the diagram 



Ki (I) ^ (A) ^ (A/ 1) Ko(I) ^ Ko (A) ^ Ko(A/I) 



HP 1 (/) ^HP 1 (.4) ^HPi (A/I) -^HPo(I) -HPo (A) ^HPo (A/ 1), 



in which the vertical arrows are induced by the Chem characters Ch : Ki HP^, 
for i = 0, 1, commutes. 

It is useful to mention here that periodic cyclic homology can be also defined 
using a variant of the cyclic complex, the X-complex, which is obtained as follows. 
Let TA ^ A be the canonical surjection defined on the free algebra generated 
by A, regarded as a vector space. Denote by I the kernel of this morphism and 
complete the usual periodic cyclic complex of T A with respect to the powers of 
I. Since TA is free, a theorem of Loday and Quillen [38] allows us to replace 
its Hochschild complex with a canonical complex of length two. This descends to 
the completion. We obtain in this way a simpler complex for the periodic cyclic 
homology of A, which gives the same cohomology, by Goodwillie’s result 2.4. See 
[22, 23, 46, 56]. 

This result was used in [53, 54] to establish a link with index theory, which 
we now illustrate with the following simple example. Let M be a smooth, compact 
manifold. We shall denote by Cp the space of bounded linear maps T such that 
Tr(|T|^) < oo, p > 1. Also, we shall denote by ^^{M) the space of classical 
pseudodifferential operators on M of order m. It is known that C Cp, 

if p > dimM. Since Cp is an ideal of the algebra C{7i) of bounded operators 
on L‘^{M) and ^^(M) consists of bounded operators, we can define the algebra 
S := + Cp, which will contain Cp as a two-sided ideal. Denote by S*M = 

{T*M \ 0)/E^5_, the cosphere bundle of M. Since Cp fl and 

the principal symbol ^ C°^{S*M) is an isomorphism, we 

obtain the following exact sequence 

^( 0 ) 

0 Cp ^ ^ ^ C(5*M) 0. 

The trace defines a cyclic cocycle Tr*(ao, . . . , ^2^+1) = x Tr(aoai . . . a 2 k+i) 
on Cp, if 2/c + l > p, [20]. The connecting map d in A-theory in the above diagram, 
when composed with Tr^ gives the analytic index 

Indexa = Tr^od: Ki{C{S%M)) — ^ ATo(Cp) ^ Z. 

The Atiyah-Singer index theorem [1] can then be rephrased using Theorem 2.6 to 
say that 

d[Tr^] - 7T* Td(M) n [S*M] G 0 R2k+i(S*M) = KP\C°°(S*M)), 

k 
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where d : HP^((7°°(MxM)) ^ EF^{A{M)) is the boundary map in periodic cyclic 
cohomology, Td(M) is the Todd class of M and [Tr*] is the class of Tr^ in periodic 
cyclic cohomology. See also Theorem 3.1. The reader should be warned that there 
exists no proof of the Atiyah-Singer index theorem based on Theorem 2.6, although 
this would certainly be very interesting. This example can be generalized to give 
a proof of the Connes-Moscovici index theorem for coverings [54] . 

The last two theorems underscore strong similarities between periodic cyclic 
homology and A-theory. It is worth mentioning however that periodic cyclic ho- 
mology is much easier to compute, and hence it is known for many more algebras, 
than K- theory. 



3. Introducing topology 

In applications one is often interested in algebras with topology. Then in the 
definition of Hochschild and cyclic (co) homology one has to take the topology into 
account, and this means to complete in a suitable sense. 

A locally convex algebra is a locally convex vector space A over C equipped 
with a separately continuous multiplication. In many examples the locally convex 
algebra A will be a Frechet algebra, in which case the multiplication map will 
be jointly continuous. Given that cyclic type homology theories of an algebra are 
defined using complexes constructed from the tensor algebra of A it is clear that 
topology on A will force one to decide which topological tensor product to use. 

The inductive tensor product solves the universal problem for separately 
continuous bilinear maps in the sense that any such map E x F G, where 
E,F,G are locally convex topological vector spaces, extends to a continuous linear 
map E F G. The projective tensor product (8)^^ solves the same universal 
problem for jointly continuous bilinear maps. When is a Frechet space, then 
E E E 07 T as any separately continuous map is automatically jointly 
continuous, by [8, III.30, Corollary 1]. When E is also a nuclear space, a further 
simplification takes place as then there is a unique topological tensor product 
which is compatible with the algebraic tensor product. 

A basic example of this situation is provided by the algebra A of smooth func- 
tions on a compact manifold. As a locally convex vector space, A is a complete, 
nuclear Frechet space. In this case, a suitable topological tensor product to con- 
sider is the completed projective tensor product (§) [28, Definition 2, p. 32]. In the 
remainder of this paper we shall restrict our attention to Frechet algebras and so 
our topological tensor product of choice will be the completed projective tensor 
product. More details on the related issues can be found in [ 11 , 22 ]. 

Let us assume that A is a Frechet algebra. We can define then 

H,{A) ■■= A0A(8) . . . 0A, (^ + 1) factors , 

where (g) denotes as before the completed projective tensor product, which is the 
standard definition of the Hochschild complex for topological algebras. (The dif- 
ferentials b and b' then extend to the projective tensor product because of the 
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continuity of the multiplication.) We shall denote the homology of the Hochschild 
complex \= ('Hq{A)^b) by HHg(A), as before. 

The following theorem from [ 20 ] generalizes Theorem 1.4 to the topological 
case. This theorem is one of the main reasons why Hochschild homology is re- 
garded as a generalization of differential forms and why periodic cyclic homology 
is regarded as a generalization of de Rham cohomology. 

Note that the HKRC-map extends to the projective tensor products. 

Theorem 3.1. Let M be a smooth compact manifold and let be the 

space of smooth q-forms on M. Then the HKRC map induces isomorphisms 

Consequently, HPq(C°°(M)) ~ The dual identifications are valid 

for the corresponding cohomologies. 

Proof. Let A = C^{M). We begin by noticing that [28, Ch. 2, Example 1, 

p. 80] 

(3.1) HqiA) := 

Assume now that M is (diffeomorphic to) a compact ball in a Euclidean space. 
Then the proof of our theorem is exactly as that of Proposition 1.3, but only after 
replacing A^ by C^{M x M). (It is implicit here that the theory of resolutions 
and derived functors extends to topological algebras. Indeed, recall that this is 
achieved by requiring all maps to have closed, complemented images.) 

Then we need a localization principle that will help us reduce the proof to 
the case of a closed ball in a Euclidean space. To this end, we shall adapt an 
argument from [16]. Let Fk be the set of functions f : C that vanish on 

a neighborhood of the set {{x,x, ... ,x,xi, , Xq-k)} C (/c -h I repetitions 

of x), for any x,xi, . . . , Xq-k G M. 

Then Fq C Fi C . . . and bFk C Fk- Let F_i =0. We claim that each complex 
Fk/Fk-i is acyclic. Indeed, fix a metric on M and choose for any e > 0 a smooth 
function g^ : ^ C such that ge{x,y) = 0 if the distance between x and y is less 

than e/2 and g^{x,y) = 1 if the distance between x and y is greater than e. Let 

(Z/g/)(a^Q, X\, ... , Xg_|_i) != g^{Xk — \, Xj^^f {xq, . • • 5 X]^ — i, Xj^-^i, . . . , Xq-i-i). 

Then (bLe-hL,b)f-(-l)^g(xk-i,Xk)f e Fk-i and g(xk-i, Xk)f = / for e > 0 
small enough. This verifies our claim that Fk/F^-i is acyclic. 

Let Foo — U^n- The spectral sequence associated to the resulting filtration 
of Foo is a first quadrant spectral sequence, and hence Fqo is acyclic. 

Denote by H{M) := 'H{M)/Foo- Then the natural projection 

n{M) ^ n{M)/F^ 

induces an isomorphism in homology {i.e. it is a quasi-isomorphism). We can thus 
replace H{M) with H{M) in our calculation. This has the advantage that 
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if ^ C M is a closed manifold (possibly with boundary) such that (j) has support 
in the interior of B. The action of (j) was defined in Equation (1.4). Since the 
cohomology of 'H(B) is known, determined by the HKRC-map y and y(</>x) = 
(j)X{^) for ^riy X in a Hochschild complex, a partition of unity argument can be 
used to complete the proof. 

The corresponding result for cohomology follows by observing that the range 
of h in the Hochschild complex is closed, by the result we have just proved for 
homology. This is enough to conclude that the fact that y is an isomorphism in 
homology implies that the dual map y' is an isomorphism in cohomology. □ 

The resulting isomorphism helps identify the Chern characters on Kq and Ki 
with the classical Chern characters (up to normalization factors involving 2m) ^ see 

[12, 52]. 

Our final remark in this section is that many general results proved for cyclic 
type homology theories for algebras without topology carry over to the topological 
case. The most important of these is excision. The method of Cuntz and Quillen 
has been extended by Cuntz to the case of topological locally multiplicatively 
convex algebras [22] , and more recently, to the category of bornological algebras 
[46]. 

The periodic cyclic homology of algebras of this type satisfies the excision 
property with respect to extensions 

0^ j A-^ A/J ^0 

of algebras from one of the categories mentioned above where the surjection on the 
right has a continuous (or bounded, in the bornological case) linear section. This 
implies that, as a topological vector space, the image of the ideal J is complemented 
in A. This requirement can be relaxed at the cost of requiring that J be iif-unital 

[ 10 ]. 



4. Algebras of pseudodifferential operators 

The R"— theory of many important algebras is difficult to compute [4]. Often 
a good substitute, especially when one is interested in index theorems, is provided 
by periodic cyclic homology. 

If M is a smooth compact manifold, then an interesting algebra is the algebra 
A{M) of complete classical symbols on M. The computation of the homologies of 
this algebra was carried out in [15], and the result for the periodic cyclic homology 
is: 

HP,(.4(M)) ~ 0H«+2^(5*M X S^), q = 0,l, 

iez 

where tt : S*M ^ M is the cosphere bundle of M. 

Other interesting examples are provided by algebras of pseudodifferential op- 
erators on groupoids [47, 55]. Let ^ be a longitudinally smooth groupoid with 
corners with space of units a manifold with corners M. Denote hy d,r : Q ^ M 
the domain and range map of So ^ is itself a manifold with corners but we 
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assume that the fibres of d are smooth manifolds (without boundary or corners). 
The algebra 

= IJ 

of (scalar) claissical uniformly supported pseudodifferential operators on Q is then 
defined, see [36, 47, 55]. For basic facts about pseudodifferential operators, see 
one of the many monographs available, for example [50], [57], or [58]. 

The algebra of smoothing operators is by definition 

;= Pi 

The algebra 

A{g) 

of complete symbols on g is endowed with an inductive limit topology. In order 
to provide a natural framework for a homological study of such algebras, one is 
led to a wider category of algebras with topology that we shall call topologically 
filtered algebras [5, 6]. 

The reader not familiar with groupoids can assume that our algebras of pseu- 
dodifferential operators are the algebras of classical pseudodifferential operators 
on a smooth, compact manifold. This corresponds to the case g — M x M. 

We shall now study the homology of the algebras A{M), and, more generally, 
A{g). A convenient approach is provided by topologically filtered algebras, which 
are algebras A endowed with bifiltrations FfP'A C A satisfying suitable conditions. 
Before formally formulating the definition of a topologically filtered algebra, let 
us just say that in the case oi A = A{M), M compact, F^A is independent of 
m. The second index, or filtration (with respect to m), is needed in order to treat 
algebras of compactly supported complete symbols on a non-compact manifold. 

Recall that an algebra A with a given topology, is a topologically filtered algebra 
if there exists an increasing bifiltration F^A C A^ 



F^A C F^ A, if n < n' and m < m'. 



by closed, complemented subspaces, satisfying the following properties: 

(1) .4 = U„,„F^^andF-U = 0; 

(2) The union An ■= UmF™v4 is a closed subspace such that 

(3) Multiplication maps ® F^'A to 

(4) The maps 



^AjF^_^A®F^ A! F^_^A 



pm+m' j / ^m+m' \ 

^ n-\-n' '^1 ^ n-\-n' —j'^ 



induced by multiplication are continuous; 

(5) The quotient F^A/F^_^A is a nuclear Frechet space in the induced 
topology; 
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(6) The natural map 

— lim j ^ oo 

is a homeomorphism; and 

(7) The topology on A is the strict inductive limit of the subspaces F^A, 
as n ^ oo (recall that F^A is assumed to be closed in F^^^A). 

As the referee has pointed out, we can replace conditions (4), (5), and (7) 
with the condition that ^ be a nuclear LF-space with a separately continuous 
multiplication. 

For topologically filtered algebras, the multiplication is not necessarily jointly 
continuous, and the definition of the Hochschild and cyclic homologies using the 
projective tensor product of the algebra A with itself, as in the previous section, 
is not very useful. For this reason, we change the definition of the spaces HmiA) 
defining the Hochschild complexes as follows. 

Consider 

(4.1) F;= lim ^ 

^ m^oo ‘ ^ •’ 

^0 + --- + ^qr— P 

(projective tensor products) which defines an increasing sequence of subspaces 
{i.e. filtration) of We use this filtration to define 'Hq{A) as a completion. 

Namely, 

(4.2) FpT^^(^) :=lijmF;/F;_^- and HqiA) := yj^F^H^iA) 

where j ^ oo in the projective limit. The operators h and B extend to well defined 
maps, still denoted b and H, defined on 'Hq{A), for any q, which allows us to define 
the cyclic complex and the cyclic homology of the algebra A as the homology of 
the complex (C^{A),b-\-B), with Cq{A) := ®'Hq- 2 k{A) , as for topological algebras. 
For any topologically filtered algebra, we denote 

Gt(^A^ ^nAn/An—l 

the graded algebra associated to A^ where An is the union as before. Its 

topology is that of an inductive limit of Frechet spaces: 

Gr{A) ~ lim ^.4, 

N,m-^oo 

which makes sense by (2) in the definition of the topologically filtered algebra A. 

For the algebras like Gr{A), we need yet a third way of topologizing its iterated 
tensor products. For our purposes, the correct definition is then 

H,(Gr{A)) := lim ( F„-.4/Fr_i.4)®’+'. 

A,m— ^oo 

Note that this is not intended to be a “topological tensor product,” but just a 
vector space, which happens to suit our purposes. This corrects the definition in 
[5], which is algebraically not so convenient as this one, although it does give a 
topological tensor product. 
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The Hochschild homology of Gr{A) is the homology of {H^{Gr{A)),b). The 
operator B again extends to a map B : l~Lq{Gr{A)) l~Lqj\-i{Gr{A)) and we can 
define the cyclic homology of Gr{A) as above. The operators 5, B and I associ- 
ated to Hq{Gr(A)) are the graded operators associated with the corresponding 
operators (also denoted S,B and I) on Hq{A). 

The Hochschild and cyclic complexes of the algebra Gr{A) decompose natu- 
rally as direct sums of complexes indexed by p G Z. For example, Hq{Gr{A)) is 
the direct sum of the subspaces ?iq(Gr(A))p, where 

n,{Gr{A))p = lim 0 , 

kj 

where fco + + . . . + = p and — N < kj < N. 

The corresponding subcomplexes of the cyclic complex are defined similarly. We 
denote by HHH=(Gr(yl))p and RC:^.{Gr{A))p the homologies of the corresponding 
complexes (Hochschild and, respectively, cyclic). 

The following two results are consequences of standard results in homological 
algebra (for topologically filtered algebras they were proved in [5]). 

Lemma 4.1. Let A be a topologically filtered algebra. Then the natural filtra- 
tions on the Hochschild and cyclic complexes of A define spectral sequences EH^ 
and EC^ ^ such that 

EH^ ~ EBk+h{Gr{A))k and EC^ ~ BCk+hiGriA))k. 

Moreover, the periodicity morphism S induces a morphism S' : EC^ ^ EC^ 
of spectral sequences. For r = 1, the morphism S' is the graded map associated 
to the periodicity operator S : IlCn{Gr{A)) HCn~ 2 {Gr{A)) and the natural 
filtration of the groups HCn{Gr{A)). 

Let us go back now to the algebra of complete symbols on our groupoid Q. 
We shall denote by 0{M) the space of smooth functions on the interior of M that 
have only rational singularities at the boundary faces. If every hyperface H oi M 
has a defining function xh, then 0{M) is the ring generated by C^{M) and x^^. 
Let then 

Ac{G) :=0{M)A{g). 

Proposition 4.2. [5] Assume that Q and M are as above and that M is 
(7 -compact. Then the quotients A{Q) and Ac{G) are topologically filtered algebras. 

The multifiltrations are given by the order of the symbols, an exhaustive se- 
quence of compact subsets and the degree of the rational singularities. See [5, 6] 
for more precise constructions. 

Let AG be the Lie algebroid of G and let 5*^ be the sphere bundle of A*G^ 
that is, the set of unit vectors in the dual of the Lie algebroid of G- Denote H|?^ = 
H^^^^ the singular cohomology with compact support and coefficients in C. 
The de Rham cohomology of compactly supported differential forms with only 
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rational singularities at the corners will be denoted by H and 

will be called the Laurent-de Rham cohomology. 

The periodic cyclic homology of the algebras A(G) and Ac(G) can be computed 
without any further assumption on the groupoid G [5]. 



Theorem 4.3. Assume that the base M is a-compact, then we have: 

HP„(.4(0)) ~ X 5‘) and HP„(^£(0)) ~ x 5>). 

This theorem generalizes several earlier calculations. For instance, let F C 
TM be an integrable subbundle of the tangent bundle TM to M and assume 
for simplicity that M is smooth. Then the algebra of complete symbols along the 
foliation defined by F coincides with Connes’ algebra [19, 48], except that we 
require transverse smoothness [55]. We denote this algebra by A{M,F). 



Theorem 4.4, 
by: 



The periodic cyclic homology of the algebra A{M, F) is given 
EPg{A{M,F)) ~ X 5’i). 



Finer differential invariants can be captured by computing Hochschild ho- 
mology. Recall that A*G M, the dual of the Lie algebroid of 5, is a Poisson 
manifold with corners. We shall then denote the Poisson differential associated 
with this structure by S, see [13]. If A*G \ 0 denotes the open submanifold of A*G 
which is the complement of the zero section, then the radial action of allows us 
to consider /—homogeneous A:— forms Gl^(A*G '^0)i and Laurent type homogeneous 
forms Qf^{A*G \ 0)/. It is then easy to check that the Poisson differential sends 
9j^{A*g-^Q)i (resp. OJl{A*g -.Qt)i) to \ 0)/_i (resp. 

We shall denote the resulting homology spaces by 0); andHf 

Proposition 4.5. The algebra Ac{G) is H-unital. Let 
X:EBi{Gr{A))d^n\A*{g)~^0)d 

be the HKRC-isomorphism, and let di : EH^ ^ ^ EH[_j be the first differential 
of the spectral sequence associated to A by Lemma 4A. Then X^diox~^ = 
and hence ~ \ 0)a;. 

Proof. As we have already observed the term EH^ ^ of the above spectral se- 
quence coincides with the Hochschild homology space ERk+h{G'^^{Ajr{G)))k‘ Since 
the graded algebra Gr{Ac{G)) is commutative, we can use the HKRC-map to iden- 
tify EH^ ^ with the space of (/c -h /i)— forms on \ 0 that are /c— homogeneous 
with respect to the radial action of 

The rest of the proof consists in identifying the differential 

d^ : EH^ — > 



under the HKRC-map. 
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Let ^ be a quantization map q : S'^{A*Q) (this map is a local inverse 

for the principal symbol) . Choose an anti-symmetric tensor in the last m- variables 

»? = '^Slgn{a)fo ® fa(i) (g) . . . (g) 
with fj e We denote by 

= X^sign((T)g(/o) ® g(/^(i)) ® ... ®g'(/^(™)) 
the quantization of rj. Let k — deg /o + • • . + deg fm be the total degree. Because 
[q{a), q{b)] = -y/^q{{a, &}) + ..., 

where the dots represent terms of order at most deg a -f deg 6 — 2, the quantity 
b o q{r]) is of total order at most k — 1 and hence, modulo terms of order k — 2, 
X o 6 o q{r})) is easily checked to be exactly S{r]). □ 

5. Applications and examples 

5.1. Manifolds with corners. When the groupoid G is the groupoid de- 
scribing the 6-calculus (i.e. the “stretched product,” M^, in Melrose’s terminology) 
on the manifold with corners M, the spectral sequence associated with Hochschild 
homology satisfies 

Ek,h = 0 h^n, 

and hence it collapses at EH^. The asymptotic completeness of the algebras of 
complete symbols shows that this spectral sequence also converges (this is part of 
a more general result on topologically filtered algebras, [6]). Therefore, for these 
algebras, the computation of Hochschild homology is complete. 

It turns out that many algebras of complete symbols on manifolds with corners 
become isomorphic when introducing Laurent coefficients [6, 45, 49, 35]. Because 
of this, we shall denote the algebra of complete symbols on the groupoid simply 
byA^(M). 

Denote by H^{X) the homology of the complex ((9(A)n*(A), d) of de Rham 
differential forms with Laurent singularities at the boundary. 

Theorem 5.1. Let M he a manifold with corners. We have 
HEg{Ac{M)) ~ X 5^). 

As an easy consequence of this theorem, we obtain the dimension of the space 
of residue traces on manifolds with corners. 

Corollary 5.2. The dimension of the space of traces of Ac{M) is the num- 
ber of minimal faces of M. 

We now turn to the computation of cyclic homology. A direct inspection shows 
that the operator B is trivial in this case. This allows us to deduce also the cyclic 
homology of Ac{M). 
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Theorem 5.3. Let M he a smooth, compact manifold with comers. We have 



UG,iAc{M)) ~ 0HH,_2fc(.4£(M)). 

k>0 

5.2. Fibrations by manifolds with corners. Assume now that the group- 
oid 0 describes the vertical pseudodifferential calculus on a connected fibration 
with corners tt : M B over a smooth manifold B. Then we shall denote Ac{Q) 
by Ac{M\B), because these algebras turn out to be isomorphic under some pretty 
general conditions. 

When the manifold M has no corners and Q = M Xb M is the space of pairs 
of points with the same projection on B, we recover the Atiyah-Singer algebra 
of families of smooth complete symbols along the fibers of the fibration M 
B, described for example in [2, 5]. Denote by n the dimension of M, by p the 
dimension of the fibers and by q the dimension of B. 

Denote by the local coefficient system over B defined by 

P{b) := HH2p_^(.4£(7r-i(6))) 

where ttq X ^ B is the natural projection and is the vertical 

cosphere bundle. 

Theorem 5.4. Let M ^ B be a fibration of manifolds with corners, with B 
smooth, then 

hh„(^£(m|s)) ~ 0 

k-\-h=m 

As an easy consequence and in the case without corners for simplicity, we 
obtain that (when p > 2), residue traces are in one-one correspondence with 
distributions on the base manifold B. 

5.3. Longitudinal symbols on foliations. Foliations provide several ex- 
amples in noncommutative geometry. We shall look hence at the case of complete 
symbols on the holonomy groupoid of a foliation, that is the case of the algebra of 
complete symbols along the leaves of a foliation. 

We first need some definitions and notations. Let {X, F) be a smooth manifold 
X of dimension no equipped with a regular smooth foliation F. The transverse 
bundle to the foliation {X, F) is the quotient vector bundle ly — TX/F. We denote 
by po the dimension of F. The codimension will be denoted by qo so that no = 
Po + ^o- 

The space F) denotes the space of differential forms of bidegree {k, h), 

i.e. of smooth sections of the bundle A^F* 0 A^i/*. A choice of a supplementary 
subbundle H to F in TX induces the splittings 

(5.1) :T*X^F*0i/* and O'^(X) ^ 0 

k-\-h=d 
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The splitting (5.1) endows with a bigrading so that the de Rham differential 

decomposes as a sum of three bihomogeneous components 

d = dp T d-\ T 

where dp is the (1,0) component called the longitudinal differential, d~\ is the (0, 1) 
component and d is an extra component which can be shown to have bidegree 
(-1,2) [59], 

For s = 0, • • • , Qo we get the longitudinal de Rham complexes (11*’^ (X, F),dp) 

0 -4 F) ^ F) f) ^ o. 

Let H^’^(X, jP) denote the homology space of the longitudinal de Rham com- 
plex. The de Rham cohomology spaces of the smooth manifold X will be denoted 
by H^(X) as is customary. 

Dual to (/c, h) -differential forms, we define a (/c, ^)-current as a generalized 
section of the bundle A^°“^(F*) A^°“^(z/*) (g) where is the orientation 

line bundle of ly. We denote the space of (/c, h)-currents by Ak^h{X, F), By choosing 
a transverse distribution H, we can view any (/c, /i)-current as a continuous linear 
form on the space of compactly supported differential (/c, /i)-forms with respect to 
H. By duality, we define a longitudinal differential on (/c, h)-currents, still denoted 
dp, and get in this way longitudinal complexes {A^^h{X, F),dp)o<h<qo- 

0 ^ ^ ^ ^ 0 . 

The homology of this complex is denoted F). 

Let now (M, F) be a new smooth connected foliated manifold with dim(Af ) = 
n and dim(.P) = p. We assume that the bundle F is oriented and we denote by 
q the codimension of the foliation, so that n = p q. The above manifold X will 
be a total space of some fibration over M with an induced foliation F, as we shall 
see. 

If we denote by ^^{M,F) the set of (compactly supported) pseudodiffer- 
ential operators of integer order < m along the leaves of F, then ^“^(M, F) = 
nmez ^’^(^5 F) is isomorphic to the smooth convolution algebra C^{Q) of the ho- 
lonomy groupoid Q associated to F, [55]. We shall denote as usual by ^^(M, F) — 
F) the set of all classical pseudodifferential operators of integer order 
along the leaves of F. Then we obtain the usual exact sequence 

0 ^ C^{Q) ^^{M,F) — > A{M,F) ^ 0, 

with the quotient A{M, F) being the algebra of complete symbols along the leaves 
ofF. 

We endow X = S*F* x with the foliation F whose leaves are the total 
spaces of the restriction of X M to the leaves of (M,F). In particular, {X,F) 
has the same codimension as {M,F). 

Theorem 5.5. [7] Let {M,F) be a foliated manifold, and let (EH^,F)r>i 
be the spectral sequence associated with the Hochschild homology of the algebra 
A{M, F) of complete symbols along the leaves of F , as before. 
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Then the spectral sequence {EiT ,d^)r>i converges to the Hochschild homology of 
and we have 

EHI ,^ ~ X S\F). 

The space of residue traces along the leaves of (M, T) can then be deduced. 

Corollary 5.6. HRq{A{M,T)) is isomorphic to the space x 

S^^F). Moreover when the dimension of the foliation F is >2, 

Thus, the space of residue traces on the foliation (M,F) is isomorphic to the 
space of (2p, 0)- invariant currents on {S*F x S^,F). More precisely, for p > 2 we 
get 
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Index and secondary index theory 
for flat bundles with duality 

Ulrich Bunke and Xiaonan Ma 



Abstract. We discuss some aspects of index and secondary index theory for 
flat bundles with duality. This theory was first developed by Lott. Our main 
purpose in the present paper is provide a modification with better functorial 
properties. 



1. Introduction to the paper 

This article has its origin in the work of J. Lott [21], where he develops two 
versions of secondary index theory for flat vector bundles. 

The basic relation in the first version is the transition from a complex of flat 
real vector bundles to its cohomology. The primary characteristic classes in this 
case are the Bott-Chern classes. The secondary analytic information is given by the 
analytic torsion forms. The main building block of the theory is the construction 
of a push-forward operation (primary and secondary index map) for fibre bundles 
with closed fibres. In a sense it is given by considering the fibre- wise de Rham 
complex twisted by a flat bundle as an infinite-dimensional object of the theory. 
Then one applies the equivalence relation (take the cohomology) to reduce to finite- 
dimensional vector bundles again. As shown in [14] (based on the analytic results 
of [24]) this first version of secondary index theory has the expected functorial 
properties with respect to iterated fibre bundles. 

Lott’s second version of secondary index theory involves flat real vector bundles 
with parallel non-degenerate quadratic or symplectic forms (flat duality bundles). 
The basic relation in Lott’s approach was that hyperbolic forms were considered 
to be trivial. The primary characteristic classes in this case are Chern classes and 
the secondary information is given by eta- forms. Again, the main building block 
of the theory was the construction of a push-forward for fibre bundles with closed 
oriented even-dimensional fibres. The infinite-dimensional object in this case is 
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the signature operator twisted by the flat vector bundle. By applying the relation 
one again reduces to cohomology and therefore to the finite-dimensional world. 
It turns out that Lott’s definition is not functorial with respect to iterated fibre 
bundles already on the primary level. In order to repair this defect one must enlarge 
the equivalence relation. We replace triviality of hyperbolic bundles by lagrangian 
reduction. Note that a hyperbolic bundle admits an lagrangian sub-bundle which 
has a complementary lagrangian sub-bundle. It is the existence of a complementary 
lagrangian sub-bundle that we must give up. 

The set of flat duality bundles together with the secondary information and 
taken modulo equivalence is now organized in primary L- and secondary Z-groups. 
These are quotients of the corresponding groups introduced by Lott. For maps out 
of these groups we are going to use the same formulas involving generators as 
in Lott’s work. One of the achievement of the present paper is the verification 
that these constructions are still well-defined, i.e., they factor over the enlarged 
equivalence relation. The other main result is that our version now also enjoys 
functoriality with respect to iterated fibres bundles. 

In Section 2 we define the L-functor on spaces. It only depends on the funda- 
mental group of the space. If the representation theory of the fundamental group 
is sufficiently well-known then we can explicitely compute the L-group. Then we 
study certain relations between ffat duality bundles which hold in L-theory. This 
information is needed later in the proof of functoriality with respect to iterated 
fibre bundles. We also discuss a natural transformation from L- to LC-theory. 

In Section 3 we introduce the secondary counterpart Z. We relate it with 
secondary i^-theory in Lott’s notation). Then we show how the relations 

which were already investigated in the primary case now extend to the secondary 
situation. In fact, the knowledge of many relations in Z helps in arguments showing 
well-definedness and functoriality for maps with values in Z. 

In Section 4 we study an ry-homomorphism from Z to R/Z (“ 77 ” since its 
analytic definition involves ry-invariants) and its lift to R. The homomorphism to 
R/Z comes from the natural transformation to theory and the usual pairing 
with 7<"-homology. In Lott’s version it has a lift to R. Unfortunately this lift does 
not factor over our enlarged equivalence relation. In order to repair this defect 
we introduce an extended version of L and Z-theory. This extended version now 
admits a real-valued ?y-homomorphism. It is possible to define a push-forward for 
the extended Z and Z-groups, but note that these are not contravariant functors 
of the underlying space. The properties of the extended L-groups deserve further 
study. 

In Section 5 we define the secondary index map. The verification of well- 
definedness and functoriality is based on the behavior of ?y-forms under adiabatic 
limits. So we first state these results without proof and then turn to the details 
of the secondary index map. The results of this section were the main goal of the 
present paper. 
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The last Section 6 is devoted to the proof of the adiabatic limits result needed 
and stated in Section 5. In contrast to the preceeding sections, where we tried to 
give complete proofs, in this last section we will only sketch the main steps. It 
should be clear that keeping the level of depth also across the last section would 
expand the paper by a factor of three. The arguments in the last sections are 
in fact very similar to the corresponding proofs for analytic torsion forms. For 
a specialist it should not be too complicated (but by the experience of the first 
author it is also not easy) to take the stated theorems, find their counterparts for 
analytic torsion forms together with the proof in the indicated literature, and then 
correspondingly modify this proof to show the statements for the eta- forms. 



2. The functor 

2.1. Introduction and summary. The main object of this section is func- 
tor Le from the category Top of topological spaces and continuous maps to the 
category of Z 2 -graded rings and ring homomorphisms. For a space X the elements 
of the ring L^{X) are locally constant sheaves of (anti-) symmetric forms over R 
considered up to isotropic reduction. The ring operations are induced by the direct 
sum and the tensor product. 

It turns out that the functor Lg factors over the homotopy category hTop. 
For a path-connected space X the ring Le{X) only depends on the fundamental 
group of X (see Subsection 2.3 for more details). 

On nice spaces a locally constant sheaf of finite-dimensional M-modules gives 
rise to a real vector bundle. The form on the sheaf induces a form on the bundle. 
This observation leads to a natural transformation from Lg to the complex K- 
theory functor K^. In this way we consider Lg as a refinement of K^. 

Given a /("-oriented morphism tt: X B in Top, say a locally trivial fi- 
bre bundle with fibre a closed even-dimensional manifold which admits a vertical 
Spin^-structure, there is a wrong- way homomorphism of groups : K^{X) 

Analytically, it is given by the index of the twisted fibrewise Spin^-Dirac 
operator. 

If the fibres are merely oriented, then we can use the twisted fibrewise signature 
operator to define the wrong- way homomorphism : K'^{X) K^{B). The 

interesting point about the functor L is now that can be lifted to a group 
homomorphism tt^ : L^{X) Lg/(B). It is essentially given by taking the fibrewise 

cohomology of the locally constant sheaf on X. This yields a locally constant sheaf 
on B. Using fibrewise Poincare duality, we define the (anti-) symmetric form on the 
cohomology sheaf. 

It turns out that this wrong- way map is functorial with respect to iterated fibre 
bundles and natural with respect to pull-back of fibre bundles. A similar functor 
^Lott previously defined by Lott [21] using a smaller equivalence relation so 
that I/g(X) is a quotient of L^°^^(X). The corresponding wrong- way maps 
are not functorial with respect to iterated fibre bundles. 
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In the first three sections we will denote by X a topological space and by M 
a manifold. 



2.2. Definition and first properties. 

2.2.1. Definition of L^. We now give details of the definition of the contravari- 
ant functor from the category Top of topological spaces and continuous maps 
to Z 2 -graded rings. 

Let X be a topological space. If is a ring and E is a. i?-module, then the 
constant sheaf of /^-modules with stalk E is the associated sheaf to the presheaf 
which is associates to any non-empty open subset U C X the space of sections E 
such that the restriction to subsets is given by the identity. A sheaf E of i?-modules 
over X is called locally constant, if there is an open covering {U\} of X such that 
E\rr is a constant sheaf for all A. 

If i? is a field, then we say that X is a locally constant sheaf of finite- 
dimensional modules if there is a suitable open covering such that is the 

constant sheaf with the stalk being a finite-dimensional vector space over R. If 
E is a locally constant sheaf of finite-dimensional modules over X, then let 
E* := E.omji{E^Rx) be its dual. If X ^ is a homomorphism between two 
such sheaves, then we have an adjoint q* : E"^ E* . 

From now on we consider the case R := R. Let e G Z 2 = { — 1,1}. An e- 
symmetric duality structure on E is an isomorphism of sheaves q: E ^ E* satis- 
fying q* = eq. 

To define the group Le(X) we first consider an abelian semigroup L^(X) with 
zero element. Then we construct L^{X) by introducing a relation. An element 
of the semigroup L^{X) is an isomorphism class of a pair (E,q) consisting of a 
locally constant sheaf of finite-dimensional M-modules and an e-symmetric duality 
structure q. The operation in Le{X) is given by direct sum of representatives 

{E,q) + (E',q') := {E^E'^q^q') . 

The relation on Le{X) is generated by lagrangian reduction. If i\ C ^ E 
is an inclusion of a locally constant subsheaf, then we can consider the sheaf 

:= ker(z* o cf). This sheaf is again a locally constant subsheaf of E . The sheaf 
C is called lagrangian if it is isotropic, i.e., C C and coisotropic, i.e., £-*- C C. 

We say that the element (X, q) is equivalent to zero by lagrangian reduction, 
{E.>q) ~ 0, if it admits a locally constant lagrangian subsheaf. The equivalence 
relation on L^{X) is now the minimal equivalence relation which is compatible 
with the semigroup structure and contains lagrangian reductions. 

Definition 2.1. We define Le { X ) \= L ^[ X )/ 

The class of {E^q) in Le{X) will be denoted by [E,q\. 

Lemma 2.2. L^{X) is a group. 
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Proof. We have [^, + —q] = 0. Indeed, consider the diagonal embedding 

^ ^ 0 Its image is a locally constant lagrangian subsheaf of (.F 0 .7^, ^ 0 

-q)- □ 

The Z 2 -graded ring structure L^{X) 0 L^f{X) L^^f{X) is induced by the 
tensor product: 

[JP, g][r, q'] := ® ^ , 9 ® 9 ']. 

Vee' 

The sign-convention is made such that later we have a natural transformation of 
rings from L to complex X-theory K^. 

If / : F ^ X is a morphism in Top, then /* : L^{X) L^iY) is defined by 
[f* f^q\- If is easy to check that f* is well-defined. Furthermore, it 

follows from the fact that we work with locally constant sheaves that the map /* 
only depends on the homotopy class of /. Therefore, L factors over the homotopy 
category hTop in which maps are considered up to homotopy. 

Remark 2.3. A version of this ring was first introduced by Lott 

[21]. His definition differs from ours since our relation ’’lagrangian reduction” is 
replaced by ’’hyperbolic reduction” in the definition of Lott. Here a pair (X,q) is 
called hyperbolic if there is an lagrangian subsheaf C C X such that this embedding 
extends to an isomorphism {£ 0 £*, ^can) — q), where 



qcan 



0 idc \ 
e id£ 0 i ■ 



In particular, L^{X) is a quotient of 



2.2.2. Some simple properties. In the definition of the functor Le we tried to 
generate the equivalence relation in a certain minimal way. This simplifies the 
check of the well-definedness of a transformation out of Le(X) which is given on 
representatives. To check the well-definedness of a transformation with values in 
Le{X) it is useful to know some list of further relations which hold in L^{X). 

For (X,q) as above, we also denote q{x,y) := q{x){y). If X G End(X), then 
we define its adjoint with respect to q by N' := q~^ o N* o q. 

Definition 2.4. A Z- grading of {X, q) of length n G Z is a semisimple element 
N G End (.7^) such that N has integral eigenvalues in {0, . . . , n} and N' = n—N. We 
set := ker(N — k). An element v G End(X) is called a compatible differential 
if it is of degree one with respect to the grading, = 0 , and v' — —v, i.e., 
q{vx, y) 0 q{x, vy) = 0 for x, y G T. 

If {T , q) has a Z-grading of length n, then it is the sum of the subsheaves 
The duality pairs with If it has in addition a compatible differential 

V, then we can consider the cohomology H := ker(x)/im(u). It is again a locally 
constant sheaf of finite-dimensional M-modules with an induced duality structure 
qn and Z-grading of length n. 
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have 



Lemma 2.5. (1) If {T^q) admits a Z-grading of length n, then in L^{X) we 



[A?] = 



0 



n odd, 






(2) If [T,q) admits in addition a compatible differential, then in L^[X) we have 

[T,q] = [WquY 



Proof. To show the first assertion note that for k < n/2 we can take off 
summands of the form (.7^^ q\jrk^jrn-k)- These summands represent trivial 

elements of L^{X), since they contain the lagrangian subsheaves C 

To show the second assertion first note that —[H,qn] = [kt^—qn]- Hence 
q] — Qn] = [X ^7i,q ® {—Qn)]- Let i : ker(v) ^ ^ 0 H be given by i{x) = 
x0 [x]. Then im(z) is a locally constant lagrangian subsheaf of {X®H,q^{—qn))- 
Therefore, [X ^H,q® {-Qn)] = 0- □ 

Let ^ decreasing filtration of X with = T and 

yrn+i^ _ Q yy-g obtain a dual filtration by setting = 

Arm{F^+^-^F) = {x e \ x(y) - 0 for any y e Let Gr^(J^) = 

F^F/F^^^F. We have a natural isomorphism Gr(F*) = Gr(F)* which identi- 
fies Gr^(F)* with Gr^'^(F*). 



Definition 2.6. A compatible decreasing filtration of {F , q) of length n is 
a decreasing filtration by locally constant subsheaves such that 

q: F ^ F* preserves the filtrations. 



Given a compatible filtration of (F, q) we obtain an induced e- symmetric 
duality structure Gr(g) : Gr(F) ^ Gr(F*) ^ Gr(F)*. 

Lemma 2.7. In L^{X) we have [F,q] ~ [Gr(F), Gr(g)]. 

Proof. Note that [Gr(F), Gr(g)] has a Z-grading of length n. In view of 
Lemma 2.5 (1), it suffices to show that 



jo n odd, 

A? |[Gr"/2(:F),Gr(g)|g^„/2(;r)] « even. 

By the following procedure we can decrease the length of the filtration by two. 
Note that 

[A q]=[r(B (Gr°(.F) © Gr^{T)),q © ?|G..o(^)eGrn(^)] ' 

We introduce the Z-grading of length 2 on (F 0 (Gr^(F) 0 Gr"^(F)), q 0 

0Gr^(:r)) such that Gr’^(F) sits in degree zero, F is in degree one, and Gr*^(F) is in 
degree two. There is a compatible differential v given by the inclusion Gr^(F) ^ F 
and the negative of the projection F — > Gr^(F). Using Lemma 2.5 (2), we have 
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where T' — F^T jF^T and g' is the induced e-symmetric duality structure. Note 
that {T' , q') has an induced decreasing filtration of length n — 2. 

Now we iterate this procedure. If n is odd, then it terminates at 0 G L^{X), 
and if n is even, then we finally obtain (Gr^/^(jT), Gr(g)|^^^/ 2 ^^^. □ 

Let X C be an isotropic subsheaf. Then we can consider the locally constant 

sheaf Fx •= /T. Furthermore, we let qx : Fx Fj be given by yr* 

(j_L)* 6-symmetric duality structure on Xj. 

Definition 2.8. We call {Fx,qx) tiie isotropic reduction of (F,q) by X. 

Lemma 2.9. In Le(M) we have [F,q] = [Fx,qx]‘ 

Proof. We consider the filtration of length two on F such that X := F^X’, 
X-^ := F^F. Then we can identify (Gr^(X), Gr(^)|^^i^^^) = {Fx^qx)^ We now 
apply the Lemmas 2.7 and 2.5 (1). □ 

2.3. Computation of Le{X). 

2.3.1. Definition of L^{G). Let G be any group. We define a Z 2 -graded ring 
L{G). First we define the abelian semigroups Xe(G), c G Z 2 , which consists of 
isomorphism classes of tuples {F,q,p). Here F is a finite-dimensional real vector 
space, g': F ^ F* is an e-symmetric duality structure, and p: G Aut(F, g) is a 
representation of G which is compatible with q, i.e., q: F ^ F* is G-equivariant, 
where G acts on F* by the adjoint representation p* given by p*(p) = p{g~^y. 
The operation in L^{G) is induced by the direct sum of representatives. 

We obtain L^{G) as the quotient of L^{G) with respect to the equivalence 
relation generated by lagrangian reduction. First we declare that (F,q,p) ~ 0 if 
there exists a G-invariant lagrangian subspace L C F, i.e., a G-invariant isotropic 
subspace such that — L. Then we extend ~ to the minimal equivalence relation 
on Le{G) which contains lagrangian reduction and which is compatible with the 
semigroup structure. Let [F, q, p] denote the class in L^(G) represented by (F, q, p). 

Let {F,q,p) be a generator of L^{G) and i; L ^ F be the inclusion of a G- 
invariant isotropic subspace. Then is G-invariant and the quotient jL Fx 
carries an induced c-symmetric form qx and a representation px- 

Definition 2.10. We say that {Fx^qx-, Pl) is the isotropic reduction of (F, q, p) 
with respect to L. 

Lemma 2.11. In L^{G) we have [F,q,p] = [Fx^qi, Pl]- 

Proof. We consider (F 0 Fx,q 0 {—qL)->P 0 Pl)- This tuple represents the 
zero element in L^{G)^ since it contains the invariant lagrangian subspace which 
is the image of F 0 Fl, x ^ x ^ [x]. Thus [F, q, p] - [Fx,qL,pL] =0. □ 

The ring structure is given by 

[F,q,p]*[F',q',p'] = fyfy [F ® F', g ® q', p®p']. 

Vee' 
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If X is path-connected, then Le{X) = Le(7Ti(X, x)) for any base point x G X. 
Furthermore, if / : G' G is a homomorphism of groups, then there is a natural 
ring homomorphism /* : 1^(0) L^{G') given by f*[F, q, p] = [F, q,pof]. 

2.3.2. Classification of irreducible e-symmetric forms. Let (F, p) be an irre- 
ducible representation of G. In the following we classify the invariant 6-symmetric 
duality structures on {F,p). We distinguish various cases, and in each case we 
define a Z 2 -graded group A{F,p) by the following rule. A^{F,p) is trivial if (F, p) 
does not admit an e-symmetric form. If it admits one isomorphism class of such 
forms, then we set A^{F, p) Z 2 . In the remaining case it admits two isomorphism 
classes, and we set A^(F, p) := Z. The group A^{F, p) can naturally be interpreted 
as the part of Le{G) which is generated by triples with underlying representation 
of the form (F 0 IF, p (8) 1), where W a finite-dimensional real vector space. 

If q,p are two (7-equivariant duality structures on F, then oq g AutG'(F). 
Thus there exists A G AutGf(F) such that p = where q^{x,y) = q{Xx,y). 

We call (F,p) 

• real if Endc (F) = M, 

• complex if EndG;(F) = C and 

• quarternionic if End^ (F) = H 

as algebras over E. By Schur’s lemma, every non-zero element in EndG(F) is 
invertible and hence EndG(F) is a division algebra over M. By Probenius’ Theorem, 
EndG(F) must be one of the above three possibilities. 

The real case. In this case A G E*. If A > 0, then q and p are isomorphic, 
namely p(x,y) = q{y/Xx,\/Xy). If A < 0, then p and q are not isomorphic. Thus 
given a real representation (F, p) which admits an e-symmetric duality structure 
q, then e is determined, and there are two isomorphism classes represented by 
{F,q,p) and (F,-q,p). 

We define the Z 2 -graded groups 



A{F,p) 



Z 0 0 if e — 1 , 

0 0 Z if e = — 1. 



If G is compact, by [13, §2.6, Prop. 6. 5], e must be 1. 

The complex case. In this case there is a unique up to sign I G AutG(F) 
satisfying P = —1. For X G EndG(F) we define X^ q~^ o X* o q. Then 
(/9)2 — therefore we distinguish two subcases: 

• Case C+: F = 7 

• Case C_: 7^ = -7. 

Case C-|_. In this case q{px, y) — q{x, py) for all p G EndG(F). There exists a root 
VX G AutG(F) and we can write p(x, y) = q{y/Xx^ V^y)- Thus p and q are isomor- 
phic. We conclude that given (F, p) in case C+ admitting an c-symmetric duality 
structure q, then e is determined and there is one isomorphism class represented 

by {F,q,p)- 
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We define the Z 2 -graded groups 



A{F,p) 



Z 2 0 0 if e = 1, 

0 0 Z 2 if 6 = — 1. 



Case C_. In this case q{Ix,y) = —q[x,Iy) = —eq{Iy,x). Thus if q is e- 
symmetric, then q^ is — 6-symmetric. If p and q are 6-symmetric, then we write 
X =z a b I and p = aq-\-bq^ and conclude that 6 = 0. Moreover, q is isomorphic 
to p exactly if a > 0. If (F, p) admits an c-symmetric duality structure q, then 
it also admits an — e-symmetric duality structure. The isomorphism classes are 
represented by (F,q,p), {F,—q^p) for e and (F^q^^p) and [F^—q^^p) for — e. 

We define the Z 2 -graded group 

A.(^F, p) != Z 0 Z. 

The quarter nionic case. Let 5^ C Im(IHI) be the unit sphere of complex 
structures. The R-linear involution X 1 -^ acts on Im(IH[) and restricts to an 
involution of 5^. We distinguish the following three cases 

• Case Hq: The involution is trivial. 

• Case H+: The involution is non-trivial, but has a fixed point on 5^, 

• Case H_: The involution has no fixed points on 

Case H_. In this case X^ — ~X for any X e We write A = a + 6/ 

for some I ^ S^. Then the same discussion as in the case C_ shows the following: 
If (F, p) admits an e-symmetric duality structure q in case IHI_ , then it also admits 
an —e-symmetric duality structure. The isomorphism classes are represented by 
(F,q,p), {F, -q,p) for € and {F,q^,p) and {F, -q^,p) for -e. 

We define the Z 2 -graded group 

A(^F^ p) = Z 0 Z. 

Case Hq. We can write A = a + 6/ with F = I. The same discussion as in 
case C+ shows the following: If (F, p) admits an e-duality structure q in case Mq, 
then e is determined. There is one isomorphism class represented by (F^q^p), 

We define the Z 2 -graded groups 



A{F,P) 



Z 2 0 0 if e = 1 , 

0 0 Z 2 if e = — 1. 



Case . In this case we can write A = a + 6/ + c J, where ~ I and 
= —J. Writing p — aq bq^ cq^ , as q'^ is a — e symmetric duality structure, 
we see that c = 0. On the one hand we argue as in the case C+ that p and q 
are isomorphic. On the other hand (F, p) also admits the —e-symmetric duality 
structure q'^ . If (F, p) admits an e-symmetric duality structure q in case IH+, then 
it also admits an —e-symmetric duality structure. The isomorphism classes are 
represented by (F, g,p) for e and (F, g"^,p) for — e. 

We define the Z 2 -graded groups 

A{F, p) = Z2 0 Z2. 
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2.3.3. Computation of Le{G). Let Rep(G) be the set isomorphism classes of 
finite-dimensional irreducible representations {F, p) of G on real vector spaces. For 
each (F, p) G Rep(G^) and e = ±1 we fix one e-symmetric form q if it exists. 

Theorem 2.12. We have an isomorphism of Z 2 -graded groups 

Li(G)©L_i(G)^ 0 A{F,p). 

(F,p)6Rep(G) 

Proof. Fix e e Z 2 and let Rep^{G) C Rep(G') denote the set of classes 
admitting an 6-symmetric form. We consider a generator (F,p, <j) of L^{G). 

Lemma 2.13. //(F,p, a) has no invariant isotropic subspace, then it is isomor- 
phic to a direct sum 0(/r^p)^Rep^(G) P)’ ^{F,p) eZ is non-zero 

for at most finitely many {F,p). Furthermore, n{F,p) G {0,1} if A^{F,p) = Z 2 , 
while in case A^{F,p) = Z we use the convention that —n{F,q,p) stands for 
n{F,-q,p). 

Proof. Let i: W ^ V he a, minimal C-invariant subspace. Then there is a G- 
invariant decomposition V = In fact, WC\W-^ = 0, since W was assumed 

to be minimal and it cannot be isotropic by assumption. Iterating this argument 
replacing V by W-^ we obtain the required decomposition into irreducibles. 

The multiplicity of (F, p) with A^{F, p) = Z 2 cannot be greater than 1. If there 
were two summands, then (F,q,p) 0 (F,q,p) would admit an invariant isotropic 
subspace IF = (x 0 1(x) | x G F} C F 0 F, where I G Aut^CF) is an isomorphism 
such that q{Ix,Iy) = —q{x,y) for any x,y e F. 

If A^{F,p) = Z, then either {F,q,p) or (F,-q,p) can occur with positive 
multiplicity. If they occurred both, then the sum (F, g, p) 0 (F, — g, p) would admit 
the invariant isotropic subspace IF;={x0x|xGF}cF0F. □ 

Lemma 2.14. If {V,p, a) does not admit an invariant isotropic subspace, then 
the multiplicities n(F, p) are uniquely determined. 

Proof. Assume that 

(r,p,fr)= 0 n{F,p){F,q,p) ^ 0 n{F, p)' {F,q, p) 

(F,p)€Rep'(G) (F.p)€Rep‘(G) 

are two decompositions. Consider (F, p) G Rep^(G) with n{F,p) ^ 0 and the in- 
clusion i: sign(n(F,p))(F, g,p) ^ (V,p,a) given by the first decomposition. Then 
one can check that there is a summand {F',q',p') of the second decomposition 
such that the composition of i with the projection onto this summand is an iso- 
morphism. Therefore we can take off a summand sign(n(F, p))(F, g, p) from both 
decompositions. Repeating this argument finitely many times we obtain the asser- 
tion of the lemma. □ 

Lemma 2.15. Isotropic reduction in stages can be combined to a single isotropic 
reduction. 
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Proof. Fix a generator (F,q^p). Given an invariant isotropic subspace L C 
F, we form the reduction Pl)- d Fl is an invariant isotropic subspace, 

then we further form {{Fl)n, (pl)tv)- The preimage TV of under L-^ 

Fl is isotropic and G-invariant. There is a natural isomorphism 

{^n^Qn^Pn) - ((-Tl)tv, (gL)7V, (pl)n)- 



□ 



So given (F, q, p) the possible maximal isotropic reductions are parameterized 
by maximal invariant isotropic subspaces. 

Lemma 2.16. Let L^N C F be two maximal isotropic invariant subspaces. 
Then the corresponding reductions {FL^qr, Pl) o,nd {F^^qN^ Pn) isomorphic. 

Proof. First of all L n TV is an invariant isotropic. After reduction by L n TV 
we can assume that L D TV = 0. 

We now show that (L + TV)^ n (L + TV) =0. 

We claim that TV n L-^ = 0. In fact, L + (TV n L-^) is isotropic and invariant. 
Since L is maximal, we conclude L + (TV D L^) = L. Thus TV n C N n L — 0. 

We have (L + TV)^ = Pi TV^. Let I -\-n ^ (L + TV) fi (L + TV)^. From I G 
we conclude n e L^. By the claim above n = 0. Interchanging the roles of L and 
TV, we also conclude / = 0. 

Thus (F+TV)©(L+TV)-^ = F and L-^ — F0(L-hTV)-^. Therefore, we can decom- 
pose {F,q,p) = (L + Y?l+n, pl+jv) ® ((i + A^G. <1(l+n)^ , P{l+n)^)- The second 
summand is now naturally isomorphic to both, [FL^qi, Pl) and (Fa^, ^tv, Pa^). □ 

Given a generator (y,p, <j), we have well-defined multiplicities ri(^y p (j^{F^p) G 
A{F, p) given by any maximal isotropic reduction of (F,p, a). One easily checks 
that these multiplicities are additive and satisfy ri(y _p^^)(F, p) = — rz(v p cr)(F, p) 
and 72 (v^p^^)(F, p) = P) isotropic reduction. They therefore 

define the isomorphism 

A(G) ^ 0 A^{F,p). 

{F,p)£RepdG) 

This finishes the proof of the theorem. □ 



2.4. The natural transformation to F-theory. 

2.4.1. The bundle-construction. By Top^^^ we denote the full subcategory 
of Top of paracompact metrizable topological spaces. Let K^{X) be the complex 
F-theory functor. We construct a natural transformation b: of functors 

from Top^^^ to rings. 

A locally constant sheaf of finite-dimensional M-modules on X gives rise to a 
locally trivial real vector bundle bundle (F) in a natural way. We will describe 
bundle (F) by providing the local trivializations and the transition maps. Let 
X e X and F C X be a neighborhood of x such that the restriction F|^ is 
isomorphic to the constant sheaf F^^, where F^ denotes the stalk of F at x. Then 
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we have a local trivialization bundle(^)|^ = U x Consider another point 
x' ^ X and the corresponding local trivialization bundle(^)|^, = [/' x of this 
type such that U CiU' 9. The isomorphism 

i^u")\unu' ~ ^lu'nu ~ (^X.uMunu' 

^uu' 

induces an isomorphism which we consider as the (constant) transition 

map cl)uu' ‘ U n U' ^ Hom(^ 3 ^, between the two local trivializations. 

The correspondence bundle is functorial with respect to morphisms of sheaves 
and compatible with the linear operations direct sum, tensor product, and duality 
on sheaves and vector bundles. Thus applying the bundle construction to {X,q) 
we obtain a pair (F, Q) consisting of a finite-dimensional real vector bundle and 
an isomorphism Q: F F*. The bundle-construction is also compatible with 
pull-back, i.e., if /: F ^ X is a morphism in then there is a natural 

isomorphism /*bimdle(X) = bimdle(/*X). 

2.4.2. Metric structures. Fix e G Z 2 . Let (F, Q) be a real vector bundle with an 
isomorphism Q : F ^ F* such that Q* = cQ. Following the language introduced 
by Lott [21] we define the notion of a metric structure. 

Definition 2.17. An isomorphism J: F ^ F is called a metric structure if 

(1) J* o Q defines a scalar product on F, 

(2) j2 = eidF, 

(3) J*oQ = eQoJ^ i.e., Q{x, Jy) = e Q[Jx, y). 

Since we assume that X is metrizable and paracompact, it admits partitions 
of unity. This implies that metric structures exist and that the space of all metric 
structures is contractible. 

Given (F, Q) as above, we choose a metric structure J. Let Fc be the complex- 
ification of F. Then := ^ J is a Z 2 -grading of Fc, and F± = {x G Fc, z'^ x = 

±x} are sub-bundles of Fc, thus the pair (Fc, z'^) represents an element F+ - F_ 
of K^{X) which does not depend on the choice of J. 

Definition 2.18. We define the natural transformation b: ^ by com- 

posing the latter construction with bundle. 

2.5. Push- forward for L^. 

2.5.1. Definition of . Let tt: X — > F be a locally trivial fibre bundle where 
the fibre is a closed topological n-dimensional manifold Z. There is an open cov- 
ering U = {Ux}\ of B such that (f)x: X\^^ = Fa x Z. If Fa fl / 0, then we have 
an isomorphism 

Uxnu^xzF^ ^Uxnu^xZ, 

which is of the form (b,z) i-» {b,<f)x^{b){z)), where 4>Xfi- [/a n -> Aut(Z) is a 
continuous family of homeomorphisms of Z. 
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A fibrewise orientation of the bundle tt : X — > 5 is a choice of an orientation 
of Z and of an atlas of local trivializations such that the (j)x^ are orientation 
preserving. 

Set €„ := (-1)"^ = ^ := To define 

7T^ LeW^L„„(B), 

we assume that the bundle comes equipped with a fibrewise orientation. Let 
[^,q\ £ Le[X). Then we construct a representative of ^]) as follows. Note 

that 7 t(J^) := HR'k^T \= ^ locally constant sheaf of finite dimen- 

sional E-modules. In fact, let b e U\ and = 7t“^({ 6}). Then we have 

By Poincare duality over we have an isomorphism such that ^ 

for all k e N. This isomorphism is preserved by the transition 
maps so that we obtain an isomorphism 7r{X*) = 7t(^)*. If we compose this 
isomorphism with the sum of the isomorphisms R^7r^{q ) : — > R^n^T* , then 

we obtain an ecn^symmetric duality structure 7r{q) on tt(F) (cf. Subsections 2.5.2, 
5.2.2). 

Definition 2.19. We define g]) := [7r(:F),7r(g)]. 

Lemma 2.20. is well-defined. 

Proof. By construction 7r(g) is an isomorphism with the correct symme- 
try properties. Thus our prescription (^, g) ^ [^{X),7T{q)] provides a homomor- 
phism of semigroups : L^{X) We must show that it factors over 

Le{X) Le{X). Let C C F he Si lagrangian subsheaf. It leads to a compatible 
(see Definition 2.6) filtration ^ of length 1 by F^F := F, F^F := C. 

We obtain an induced filtration [F'^'k{F )) ^ such that F^'n{F) = \m{HR'n^C 
HRtt^F) of length 1 which is compatible with 7r(g). Here one has to check that 
F^7t{F) is a lagrangian subsheaf. This can be verified either directly by looking 
at the long exact cohomology sequence associated to 0 ^ C ^ F F/C ^ 0, or 
by invoking the spectral sequence induced by the filtration and the discussion in 
Subsection 4.4.1 below. 

By a combination of Lemmas 2.5 (1) and 2.7, we have [7r{F)^7r{q)] =0. □ 

Note that {Tc{F),7r{q)) comes with a natural Z-grading of length n. Thus we 
can apply Lemma 2.5 to reduce to the middle term. In particular, we have — 0 
if n is odd. 

Remark 2.21. In [ 21 ], Lott deanes which in- 

duces by passing to quotients. 
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2.5.2. Functoriality. Here we will show that is functorial with respect to 
iterated fibre bundles. Let tti : PL ^ V and 7T2 : F —^She locally trivial fibre 
bundles where the fibres are closed topological manifolds. We assume that both 
bundles come equipped with fibrewise orientations. We set tts 7T2 o tti. We fur- 
thermore assume that W S is a locally trivial fibre bundle with fibrewise 
orientation with fiber Z. The fibre Zg (s G 5) is itself a fibre bundle. We assume 
that this bundle structure is preserved by the transition maps between local triv- 
ializations of 773. We assume that the orientation of the fibres Zg are induced by 
the orientations of the fibres of tti and 7T2. We will call this situation an iterated 
fibre bundle with compatible fibrewise orientations. 

In the smooth category, i.e., if V, and S are smooth manifolds and if tti, 7T2, 
and 7T3 are smooth maps, to give a locally trivial fibre bundle is the same as to give 
a proper submersion. Furthermore, to give a fibrewise orientation is the same as to 
give an orientation of the vertical bundle. The composition of proper submersion 
is again a proper submersion. Thus if tti : PT ^ L and 712: V S are locally 
trivial fibre bundles in the smooth category with fibre X, T, then automatically 
TTs: W S is a. locally trivial fibre bundle with fiber Z. Using the existence 
of connections and parallel transport on can produce local trivializations of 773 
preserving the bundle structure of the fibres. The compatible fibrewise orientation 
is obtained by the orientation of the vertical bundle TZ, which can be identified 
with the sum of oriented vertical bundles TX 0 7 t*TF. 

We now turn back to the general situation. 

Theorem 2.22. We have equality of homomorphisms L^{W) 

Proof. Let (T,q) be a generator of L^{W). We show that the equality 
[7T3(.F), 7T3(g')] = [7r2(7Ti(X)), 7r2(7Ti(g'))] usiug the fibrewise Leray-Serre spectral 
sequence LS^r) ^ 2) associated to the composition of functors 7 Ti+ 

and 7T2+ applied to T (cf. [18, Thm. 3.7.3], [17, p. 464]). The term l5^2 is 
given by = RP 7 r 2 ^{R^ 7 Ti^T), Furthermore, there are decreasing filtrations 

(F^R^ 7 T 3 ^R)i on R^ 7 T 3 ^R, /c G N, such that Gr(i7^7r3=,:r) ^ 

One checks that the filtration (^F^7t^{E)). is compatible with 7T3(^). To do so 
we can restrict to the fibre over some s ^ S. Let n be the dimension of the base 
Ys of the bundle Zg. The length of the filtration is n. One has to show that 

(2.1) 7T3{q){x){y) = 0 whenever x G F^tt^{T)s, y G F^7T3(.F)s, pFq> n. 

If one computes the cohomology 7T3 (J^)s = H{Zs,E\^ ) using the chain com- 
plexes ^{Zg,T\^ ) which are functorial in sheaves, and on which one can imple- 
ment Poincare duality : Q.(Zg^T\^ ) AU(Z5, X* ) — > E as well as the filtration 
[F'^^{Zs^T\^ ))^ leading to the Leray-Serre spectral sequence (cf. [ 25 ]), then one 
checks on this level that ujKijj' = 0 if u; G F^Ft{Zs^T\^ ^ Fp'Q{Zs^E*\^ ), 
andpYp' > n. It follows that the filtration is compatible with the form Q given by 
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Q{uj,lo') = A Cj', a;, cj' C Vt[Zs,^\^ ), where 

N is the Z-grading of ). The form Q induces 7T3(g) in cohomology. This 

immediately implies (2.1). 

To be more explicit in the smooth case we can take for ) as 

r2(Zs,^|^ ) the smooth ^-valued forms so that the symbols above aquire their 
usual meaning. In this case, = 7r*|^^r^-*(ys)Q(X, (also cf. 

[ 24 , §2.1]). 

By Lemma 2.7 we have [T^ 2 >{^),T^ 2 ,{q)] = [Gr(7r3(:T)), Gr(7T3(g))]. 

Now 7r2(7Ti(^)) can be identified with the term lsE 2{^) of the spectral se- 
quence and 7r2(7Ti(^)) is the induced form l 5 ^ 2 (^) (see Subsection 4.4.1 below). 
The same model as above can be used to check that the n-th term LsEn{^), n>2, 
is a locally constant sheaf on S with an induced form LsEn{q), which carries a 
compatible Z-grading and a compatible differential. We obtain the (n-f l)th stage 
of the spectral sequence by taking cohomology. Thus, by Lemma 2.5 (2). we have 
[LsEn{^),LsEn{q)] = [ls E n+i{E) , LS En-^i{q)]^ We conclude with 

[7r2(7Ti(:r)),7r2(7ri(^))] = [lsE 2 {E), LsE 2 {q)] = [LsEoo{E),LsEoo{q)] 

= [Gr(7T3(.7^)),Gr(7r3(^))] = [7T3(J^), 773 ((?)]. 

□ 

Remark 2.23. Note that this functoriality does not hold in general for 

2.5.3. Compatibility and naturality. In the present subsection we work in the 
smooth category. Let tt : M B be a locally trivial fibre bundle over a compact 
base B such that the fibres are compact even-dimensional smooth manifolds. We 
further assume that the fibrewise tangent bundle TM/B is oriented. Then the 
bundle has a fibrewise orientation. We have the following maps: 

• i/*(M,M) ^ iL*(B,E) defined by 7t^{uj) = UL{TM/B), 

where is integration over the fibre and L(T M/ B) denotes the Hirze- 
bruch L-class of the fibrewise tangent bundle. 

• K^{M) K^{B) defined by 7r^^^^([£^]) = ind(T)^^^), where 

is the fibrewise signature operator twisted by the complex vector bundle 
E ^ M and ind(D^®^) G K^{B) denotes the class of the index bundle. 

• Trf': Le{M) L^^^{B) given in Definition 2.19. 

Let ch: 7/®^(.,IR) denote the natural transformation of ring- valued 

functors given by the Chern character. 

Theorem 2.24. The following diagram commutes: 



Le{M) - 


— ^ K°(M) - 










LeeAB) - 


— ^ K°{B) - 
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Proof. Recall that the map h is defined in Definition 2.18. Commutativity 
of the right square is the assertion of the index theorem for families applied to 
the family of twisted fibrewise signature operators. The commutativity of the left 
square is a consequence of Hodge theory by which we can identify bimdle( 7 r(^)) 
with the bundle ker(Dbundie(:r)c)- O 

The following proposition is an immediate consequence of the definition. 

Proposition 2.25. The push-forward is natural with respect to pull-back 
of fibre bundles, i.e., given f : B' B we consider the pull back 

f*M -A—, M 
B' B 

and we then have {f*7r)^ o f^ = f* o . 

3. The functor Zg 

3.1. Introduction and summary. This subsection shall be considered as 
an introduction to both, the present section and Section 5. Our purpose here is to 
motivate the introduction of Lg. 

If we compose the natural transformation b\ with the Chern char- 
acter ch: then we obtain a natural transformation chob: Lg ^ 

In the present section we study the kernel of this map in detail. 

Note that Lg is given by a topological construction. Staying in the topological 
framework we first define a functor L^^^ from topological spaces to Z 2 -graded 
groups together with a surjective natural transformation to ker(ch o b). We can 
consider ch: K as a map between classifying spaces. Its homotopy 

fibre is again a classifying space of a cohomology theory i^K/z- The functor L'^/^ 
is defined by a pull-back of via b\ K^. Using the geometric 

description of LTr/z given in [20], one could also obtain a geometric description of 

As a cohomology theory A^/z admits wrong- way maps for suitably oriented 
fibre bundles. The topic of secondary index theory [20] is to relate these topological 
secondary index maps with their analytic counterparts. The main constituent of 
the construction of the secondary analytic index is the 77 -form of a family of Dirac 
operators. The well-definedness and functoriality of the wrong-way maps in the 
geometric picture encode properties of 77 -forms. As a formal consequence of its 
definition we have wrong- way maps for with nice functorial properties. 

The functor L^/^ fits into an exact sequence 

0 ^ Lf^^^(A,E)/im(ch: K\X) L^^^{X) 

— ^ker(cho 6 : K^{X) — > H^^{X,R)) — > 0. 
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It turns out that, working in the smooth category, we can define a refinement 
Lg ^ which fits into the sequence 

0 — ^ ^ L,{X) ker(cho6: K^{X) H^^X,R)) — ^ 0. 

The definition of is geometric and not (obviously) related to a cohomology 
theory. So it can be considered as a nontrivial fact that Lg still admits wrong-way 
maps with nice functorial properties. It is in fact the main purpose of the present 
paper to construct these maps and verify their functorial properties. These results 
thus encode some finer properties of the 77-forms of families of signature operators 
twisted with flat vector bundles. 

In the present section we give the definition of the secondary L-functors and 
discuss their simplest properties and relations to other functors. The wrong-way 
maps are introduced in Section 5 after a digression to 77-forms and 77- invariants. 

3.2. Secondary K-theory. 

3.2.1. Definition of We are going to recall the definition of the 2- 

periodic cohomology theory K^^/z introduced in [19], [20]. Let BU be the classi- 
fying space of complex K-theory. The Chern character (with real coefficients) is 
induced by a map ch : BU n^i^(^^)2n). The homotopy fibre of this map 
classifies In particular, for any space X there is a natural exact sequence of 

i^0(X)-modules 

... — > K-^{X) ^ K°{X) H^''{X,R) — > . . . , 

where K^{X) acts on cohomology via the Chern character. 

3.2.2. A geometric description. For a manifold M we recall the definition of 
in terms of generators and relations as given in [20, Defs. 5, 6]. We 

form the abelian semigroup consisting of isomorphism classes of tuples 

{E,h^ , p), where E = E^ 0 E- is a Z2-graded complex vector bundle, 
is a hermitian metric and = V^+ 0 is a metric connection, both being 
compatible with the grading, and p G 0®^^(M)/im(d) satisfies dp = ch(V^) := 
ch(V^+) — ch(V^~). The semigroup operation is induced by the direct sum of 
generators. On we consider the minimal equivalence relation ~ which is 

compatible with the semigroup structure and such that the following holds: 

(1) (Change of connections) We have (E,/i^, V,p) ~ {E,h^\V' , p') if and 
only if p' = p + ch(V', V). (See Section 3.6 for a definition of the trans- 
gression Chern form.) 

(2) (Trivial elements) If {E, V^) is a Z2-graded hermitean vector bundle 

with connection, then {E 0 0 V^,0) ~ 0, where E^^ 

denotes E with the opposite grading. 

The group is the quotient of K~J'.^{M) by ~. By [E, V^, p] we denote 

the class of {E,h^ , p) in 
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It was shown by Lott [20, §2] that the group given by this geometric definition 
is naturally isomorphic to the topological defined object of Subsection 3.2.1. 



3.3. The functor 
3.3.1. The definition. 

Definition 3.1. We define the functor X i-^ from to groups 

by the following pull-back diagram: 

L^/^{X) . L{X) 



Vz(^) K\X) 

Especially, L^^^{X) = {(m, v) £ K~UX) x L{X) | pu = bv}. 



On morphisms the functor only depends on homotopy classes. Note that 
K°{X) and are L(X)-modules via b. This induces an T(X)-module struc- 
ture on We have the following natural exact sequence of T(X)-modules 



K-^(X) ^ H°‘^^{X, 



L^/^{X) 



L{X) H^''{X, 



3.3.2. Secondary push- forwards. Let tt: X ^ B he a, smooth locally trivial 
fibre bundle with closed even n-dimensional fibres and equipped with an orienta- 
tion of the vertical tangent bundle TX/B. In order to define an index map for 
Kr/z we need the further assumption that tt is K-oriented. Thus assume that 
TXfB has a Spin^-structure. Then there are maps : K^{X) K^{B) and 

^Spm^,M/z, — > K^^.^{B) (the topological secondary index, cf. e.g. [20]), 

such that the following diagram commutes: 






H^^{B,R) 



H^^^{B,R) ^ ^ ^ H^^{B,R) 

where A{TX/ B) U e^^/^ U uj and ci is the first Chern class 

determined by the Spin^-structure. There is an unique element Egign € Eq{X) 
such that 7rf^^{x) = (Ensign • x). Note that ch(£^sign) U A(TX/B) U = 
L{TX/B). ' 

Definition 3.2. (1) The secondary signature index map 

^sign,R/Z^ 1 (^) 



is defined by 



Z / \ c 

{x) := 7T, 



^(-^'sign • ^)- 
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(2) The push-forward ^ is defined as the map induced 

by and tt^. 



Corollary 3.3. The following diagrams commute: 





— - 


> K°{X) 






^sign,R/z| 










-> K°{B) — 






, Z®/^(X) ■ 


. L{X) — 


H^''{X,R) 




^L,R/zj 


< 






> L^/^{B) 


L{B) — 


H^''{B,R). 



All push-forward maps are natural with respect to the pull-back of fibre bun- 
dles. Moreover, they are functorial with respect to iterated fibre bundles. In greater 
detail we have the following: Let tti: W V and 7T2: V —^Sbe locally trivial 
smooth fibre bundles with closed even-dirnensional fibres X, V. Further assume 
that the vertical bundles TX and TV are oriented and carry Spin^-structures. 
Then the composition tts = 7T2 o tti : VF — > 5 is a locally trivial fibre bundle with 
closed even-dimensional fibres Z and the vertical bundle TZ carries an induced 
orientation and Spin^-structure. In this situation the index maps on complex K- 
theory, A"j^^^^-theory, L-theory (Theorem 2.22), and in cohomology behave functo- 
rially with respect to the iterated fibre bundle. It now follows immediately from 
the definition that 



Corollary 3.4. 



L,R/Z- L,R/Z L,R/Z 
7T3^ =7To. on, 



‘2* 



3.4. The functor Z. 

3.4.1. Definition of L. The functor X Z®/^(X) from to L{X)~ 

modules was defined by a purely homotopy-theoretic construction as an extension 
of the functor 

XH->ker(cho6: L{X) ^ H^^{X,R)) 

by X H^^^{X,R)/ch{K~\X)). 

Let denote the full subcategory of paracompact metrizable spaces 

Topjnet which are homotopy equivalent to smooth manifolds. In the present sub- 
section we use a differential geometric construction to define on ^ 

functor X Z(X) to graded Z(X)-modules which extends X ker(ch o b) 
by X ^ H^^^{X,R). 

It suffices to define Z as a homotopy invariant functor on the category of 
smooth manifolds and smooth maps. Again we start with defining a abelian semi- 
groups Ze(M), e = ±1, with identity and obtain the group Zg(M) as the quotient 
of Zg(M) by an equivalence relation. 
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Let be a representative of an element of Ze(M). Then we have a real 

vector bundle F bundle (^) which carries a natural flat connection such 
that ker(V^) = F. The form Q G Hom(F, F*) which is induced by q is parallel 
with respect to V^. Let J be a smooth metric structure on (F,Q). It induces a 
Z 2 “grading z'^ := of the complexification Fc- In general, since J is not parallel 

with respect to this grading is not preserved by the connection induced by 

The even part of with respect to is a connection on Fc which preserves 
the Z 2 -grading. It will be denoted by Then 

Let {fl*{M),d) be the real de Rham complex of M. We can use this connection to 
define a characteristic form which represents the Chern class of Fc- 

Definition 3.5. We define p(V^, J) G by 

(3.1) p(V^, J) := ch(V^‘^’^) := TV. [exp(-(V^"’-')V27ri)] 

:= TV [2'^exp(-(V^'=’-^)V27ri)] . 

An element of L^{M) is an isomorphism class of tuples (F,q,J,p), where 
(F, q) is a representative of an element of (M) , J is a metric structure on 
F bimdle(F), and p G il^*“^(M)/im(d) satisfies dp = p(V^, J). The semigroup 
operation is induced by direct sum of representatives: 

(F, q, J, p) + (F', J', p') := (F 0 F', q® q' ,J 0 J', p + p'). 

Before introducing the equivalence relation we recall the definition of the trans- 
gression Chern form. Let F — > M be a Z 2 -graded complex vector bundle and let 
V, V' be two connections on E preserving the grading. Then we consider the bun- 
dle E pr*F [0, 1] x M with connection V which is given \yy V dt '■= dt {t is 
the coordinate in [0, 1]) and Vx = (l — ^)Vx0 t'^'x X eTM. We decompose 
ch(V) = dtA'y + r, where r does not contain dt and 7: [0, 1] — ^ Q{M) is a smooth 
family of forms. 

Definition 3.6. The transgression Chern form is defined by 

ch(F,V',V) [ ^{t)dt 
Jo 

It satisfies 

dch(F, V', V) = ch(V') - ch(V). 

We now introduce the equivalence relation which is again generated by la- 
grangian reduction. We consider (F, q) and a metric structure J on F. Let £ C F 
be a locally constant lagrangian subsheaf and L \= bundle (£). Then we have a 
decomposition F = L0 J(L). Let V® denote be the part of which preserves 

this decomposition. 

Definition 3.7. We define 

p{J^,q,J,C) :=ch(Fc,V®,V^"’-'). 
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We require that the equivalence relation contains the relation 
(^, q, J, p) ~ (0, 0, 0, p + p(^, q, J, C)) . 

Note that {0,0,0, p+p{J^,q,J,jH)) is agenerator of Z/£(M), since ch(V®) = Tr[J 
exp(— V®’^/27 tz)] = 0 and hence 

dp + dp{J^, q, J, C) = ch(V^^’'^) + ch(V®) - ch(V^"’^) = 0. 

Then we extend ~ to the minimal equivalence relation on L^{M) which contains 
lagrangian reduction and which is compatible with the semigroup structure. 

Definition 3.8. We define the semigroup Le(M) := L^{M)/ 

By [JT, q, J, p] we denote the class in L^{M) represented by (jT, g, J, p). 

Lemma 3.9. L^{M) is a group. 

Proof. We have [J^,q,J,p] + -q, -J, -p] = 0. Indeed, we consider the 

locally constant lagrangian subsheaf C C which is the image of the diagonal 

embedding T ^ T ^ T T . Let J := J 0 (— J) be the metric structure on 

F bundle(^). Then already preserves the decomposition F = L 0 JL. 

Hence p(F, q, J, C) — 0 , where q := q^—q. Therefore, we have (F, g, J, 0 ) 0 . □ 

3.4.2. Change of the metric structure. We consider {F^q) and two metric 
structures J, J' on the associated bundle F. We define the transgression form 

p(V^, J',J) 

such that we have 

dp{V^, J', J) = p(V^, J') - P(V^, J). 

Lemma 3.10. In L^{M) we have 

[Jf, q, J',p'] - [T, q, J, p] = [0, 0, 0, p' - p - p(V^, J', J)]. 

Proof. Let M be the space of all metric structures on M and pr: M x ^ 
M be the projection. Let F pr*F, q pCq. On the associated bundle F we 
consider the tautological metric structure J which over M x { J'} restricts to J'. 

Furthermore, we consider the sheaf F := F ® F with the form q = q ® {—q) 
and the metric structure J = J 0 (— J) on the associated bundle F. 

Finally, we define F pr*F and q — pCq. As metric structure on F we take 
J = J 0 (_pr* J). We set Jo := pr* J 0 (-pr* J). 

Let £ C F be the image of the diagonal F F ® F . Furthermore, we set 
C — pr*£. We define the form uo := p(V^, J, pr* J) + p(F, q,J,C) on M x A^. It 
is closed, since 

duj = p(V^, J) - p(V^, prV) - 

= p(V^, J) - p(V^, prV) - p(V^, J) + p(V^, prV) = 0 . 
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The metric structure J' induces an embedding ij^ : M M x {J'} M x M. 
We have 

p{F,qJ,C) = i*j,p{T,q,J,C). 

Therefore, 

p(V^, J', J) + p{F, q, J, C) = ij,u}. 

Since u is closed, ijf is homotopic to ij, and 

pr* J, J) = 0 = ijp(F, q, J, £), 

we conclude that p(V^, J', J)+p{F, q, J, C) is exact. In L^{M) we have the identity 

[F, q, J', p'] - [F, q, J, p] = [F, q, J, p' - p] 

= [0, 0, 0, p' - p + p{F, q, J, £)] = [0, 0, 0, p' - p - p( V^, J', J)]. 

□ 

Remark 3.11. In [21, Def. 23], Lott defined a similar functor It is 

also obtained as a quotient of L^{M) by an equivalence relation This relation 

is the minimal equivalence relation which is compatible with the semigroup opera- 
tion and which contains q, J', p') ~ {T, q, J, p) + (0, 0, 0, p' — p — , J', J)), 

and “lagrangian reduction” in the special case that the lagrangian subsheaf ad- 
mits a lagrangian complement. As a consequence of Lemma 3.10 the relation ~ is 
coarser than so that we have a natural surjective map — > L^{M). 

3.4.3. The module structure. 

Definition 3.12. The graded module structure of Z(M) = 0 cgZ 2 (M) 
over Z(M) is defined by 

[F,q,J,p] • [£,p] ;= p (gi f ® p, J ® J®, p A ch(V®^’'^^)] , 

yee' 

where is any metric structure on bundle(f). 

Lemma 3.13. The L{M)-module structure of L{M) is well-defined. 

Proof. Let Z^, i = 0, 1 be two choices of metric structures on {S,q). Then 
we must show that 

[T ^ S,q^ p, J (Si Jq , p /\ )] = [!F S S,q Sp,J <S Ji , p A )] . 

In view of Lemma 3.10 we must show that 

p A ) - p A ch(V^^’Z^ ) - p(V^®^, J S J S Ji) 
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is exact. We compute 

p A ) - p A J ( 8 ) Jo^, J O Jf ) 

= p A dch{V^^^'^^ , ) — ch(V^cC)^c,J® ^ yFc®Ec,JOJf ^ 

= -d(pAch(V^^’'^o^,V^^’^i^)) +dpAch(V^^’'^o^, 

- ch(V^^’'^) A ch(V^^’'^o"^, 

= -d(pAch(V^^’*^o^, 

□ 

3.4.4. Complexes and p-forms. We consider a pair {T, q) together with a Z- 
grading N of length n and a compatible differential v (cf. Definition 2.4). 

Definition 3.14. A metric structure J is called compatible with N if JN + 
NJ = nJ. 

Equivalently, one could require that the decomposition F = ^ 

into eigenspaces of N is orthogonal with respect to the metric induced by J. 

The adjoint of v with respect to the metric induced by J is given by = 
—eJ o V o J. Set V = -h v. By Hodge theory we can canonically identify the 
cohomology bundle H = bundle(?-^) with ker(i;) n ker(i;*^). Since the latter is 
J-invariant we obtain an induced metric structure := j\^ for {H,qn)- 

The theory of characteristic classes and forms extends to super connect ions 
(cf. [ 27 ], [ 3 , §1.4]). Since we consider several Z 2 -gradings at the same time we will 
speak of ^-superconnection in order to indicate that z is the relevant grading. In 
particular, given a 2 :-superconnection A we set 

ch(A) := ^pTr 1^ 2 ; exp(— A^)j , 

where cp multiplies ap-form by (27ri)~^/^. Furthermore, if A' is a (— l)^-supercon- 
nection on F, then the odd part A with respect to 2 ;^^ = J is a 2 ;'^-superconnec- 
tion. In this case we define p(A', J) \= ch(A). 

Let M (0,oo) x M and pr: M — ^ M be the projection. We consider 
(F, V^) = pr*(F, V^) and q := pCq on M. It has the Z-grading N := pv*N of 
length n and the compatible differential v := pr*i;. We further consider the com- 
patible metric structure J which restricts to on {t} x M. We 

have a (— l)^-superconnection A' V^+h. Let us decompose p( A', J) = dtAy+r, 
where r does not contain dt. Here 7 : (0, 00 ) — > Q{M) is a smooth family of forms 
on M. More precisely, 

7(t) = 

Remark that JV = —VJ. Thus V is odd with respect to the Z 2 -grading z'^ . By 
[21, Prop. 28 and Prop. 29], (also cf. [8, (2.26)]) the following integral exists. 
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Definition 3.15. [ 21 , Def. 32]. The 7/-form N, J,v) e 0(M) is defined 
by 

poo 

f}{T,N,J,v) j{t)dt. 

Jo 

It was shown in [ 21 , (216)] (cf. [ 7 , Thm. 2.8]) that 

(3.2) dfj{J^, N, J, v) = KW, J) - P(V", J"). 

Proposition 3.16. In L^{M) we have 

[T, q, J, p] = [n, qn, J^,P ~ v{^, N, J, w)]. 

Proof. We consider (G,Qg) '= H admits a locally constant 

lagrangian subsheaf C given by the image of ker(u) ^ x ^ x ® [x]. We 

consider the metric structure J 0 — J^. Then we have 

\T, q,J,p]-\H,qn,J^ ,p- N, J, t;)] 

= [g,qg,J°,ii{^,N,J,v)] 

= [0,0,0,fj{J^,N,J,v)+p{Q,qg,J*^,£.)]- 

It remains to show that N, J,v) + p{g,qg,J^,C) is exact. This will be a 
consequence of the following general result. 

Lemma 3.17. Let Eta be a construction which associates to a tuple (F, V^, (J, 
TV, J, u) (a real vector bundle with flat connection, parallel e-symmetric form, com- 
patible parallel 7j-grading, a metric structure (not necessarily parallel), and compat- 
ible parallel differential) over a manifold M a form Eta(F, V^, Q, TV, J, v) E Q{M) 
such that 

(1) dEta(F, V^, Q, N, J, v) = p(V^, J) - p(V«, J"). 

(2) For a smooth map f : M' M we have 

r Eta(F, V^, Q, N, J, v) = Eta(/*f, /* f*Q, f*N, f*J, /* «). 

(3) Eta(F, V^, Q, TV, J, r») depends smoothly on the data {note that we 

fix TV and v). 

(4) If {F,V^,Q,N,J,v) splits, then Eta(F, V^, Q, A^, J, ^) = 0. Here (F,V^, 
Q, TV, J, v) splits if and only if the complex (F, TV, v) is of the form 

0 ^ F^0F° F°0F^0F^ ^ F^"^0F^-^0F^“^ ^ 0F^"^0F^ ^ 0 

with flat vector bundles E^,W, where the differential v is given by the obvious 
maps. Furthermore, = {E'^Y , = {H'^~Y* , and this identification gives 

{with the suitable signs) the form Q. The metric structure J shall induce a metric 
such that this splitting is orthogonal and the identifications E'^~'^~^ = (F*)*, W = 
{H^-^Y dPQ isometries. 

Then Eta(F, V^, Q, TV, J, v) — fj{T, TV, J, v) is exact. 
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Proof. The proof is very similar to the axiomatic characterizations of ana- 
lytic torsion forms [12, A 1.2] (in the acyclic case) and its extension to the case 
with cohomology [24, Lemma 3.1]. 

First one shows that the 77 -form rf{T, N, J, 7 ;) has the four properties above. 
Given another construction Eta(F, V^, (5, A", ^7, 7 ;) with these properties one con- 
siders the difference A(F, V^, Q, A, J, 7 ;) := Eta(F, V^, Q, A, J, 7 ;) — A, J, 7 ;). 
Then one applies the argument of [12, A1.2] to show that A(A, V^, Q, A, J, 7 ;) 
is exact. First observe by property (1) that A(F, V^, Q, A, J, 7 ;) is closed. Then 
the idea is that we can deform V,Q,J to approximate the split case. Using the 
properties (2), (3), and (4), we see that A(F, V^, Q, A, J, u) can be smoothly de- 
formed to zero without changing its cohomology class. This implies exactness of 
A(F,V^,Q,A, J,t;). □ 

We now finish the proof of Lemma 3.16. Given (F, V^, Q, A, J, 7 ;) we can 
construct {Q,qg,J^,C) as above. Let Eta(F, V^, Q, A, J, 7 ;) -p{Q,qg, , C). 
One checks that it satisfies the four conditions of the lemma. We conclude that 
fi{T, A, J, v) -h p{G, qg,J^, C) is exact. □ 



3.4.5. Filtration. Let (F, q^ J, p) be given with a compatible filtration (F^F)^ 
of length n. We assume that we have chosen a metric structure on (Gr(F), 

Gr{q)) which is compatible with the Z-grading. For i < n/2 we consider the 
following sheaves 



Si F^F/F^-^+^F© Gr^-^(F) © Gr^(F). 

We introduce forms qi and metric structures F by induction on i. 

The sheaf Si admits a Z-grading A^ of length 2 such that S^ = Gr’^“*(F), 
S^ = F^T , and S^ = GF(F). The differential Vi is given by the embedding 
Gr’^“*(F) ^ jr j j: ^Yie negative of the projection 

GF(F). For i = 0 we have an obvious form go •= (It ® lcrO(.F)©Gr^(.;^) 

a compatible metric structure Jo J^ © 
compatible. 

Assume that we already have defined qi such that the grading and the differen- 
tial are compatible. We identify F'+^F/F^“'F with the cohomology of Vi. There- 
fore, we have an induced form qpi+ijrjpn-ijr. We now define := qpi+ip/pn-ip 

The grading and the differential of F+i are again 

compatible with g^+i. 

Assume that we have already defined Ji such that it is compatible with the Z- 
grading. Then we have an induced metric structure ^ . We now define 

Ji+i Ji+i is again compatible 

with the Z-grading. 
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Definition 3.18. We define the 77- form Gr(.F), J, e ft(M) of the 

filtration by 

lin-l)/2] 

:= ^*) + P (Cr"/T, J„/2, lGr"/^(^)j • 

i=0 

Then 

d, 77( Gr(J^) , J, ) = p( , J) - p( ) . 

Lemma 3.19. In Le{M) we have 



[P,q,J,p] = [Gr(^),Gr(5), J°^(^),p-» 7 (jr,Gr(:r),J,jG^(^))] 

' [Grl51(^), Gr(5) \g^¥(tvP - Gr(^), J, J^K^))] 

n = 0(2), 

[0,0,0,p-r7(:f,Gr(J*"),J,jG^(^))] 

n = l(2). 

Proof. We reduce the length of the filtration by two as in the proof of 
Lemma 2.7. Note that 

[Cr (JT) 0Gr J ^ ^ lGr^-h-^)©Grh^)’ ^ ^ 

by lagrangian reduction along the lagrangian subsheaf Gr^“^(.F). In fact, in this 
case 

SO that by Definition 3.7 



p {Gt^-H:F) © Gr'(^), 

^ ^Icr"- >(:F)®Gr*(J^)’^^ (-^)) = 0- 

Therefore, we obtain by Lemma 3.16 

j<i 

~ 1^^27925*^^5/^ ^ ^ Vi^i ? 5 ^2 5 ^2) j 

j<i 

j<2 + l 

The assertion of the lemma now follows by induction on L □ 
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3.4.6. Isotropic reduction. Assume that we are given a tuple {T, q, J, p) and 
an isotropic locally constant subsheaf X, i.e., X C X^. We consider the filtration 
of length two of T such that X := X^ := F^T so that we can identify 

(Gr^(X’),Gr(g)|^^i^^^) = {Fx.qx)- We choose any metric structure Let 

jGr(:r) Then we have the form fj{F^ Gr(X*), J, The follow- 

ing assertion is an immediate consequence of Lemma 3.19. 

Corollary 3.20. In Le { M ) we have 

[J^, q, J, p] = [^i, qj,J^\p- v{T, Gr(J^) , J, )] . 

Sometimes we would like to work with easier transgressed characteristic classes 
than 77-forms. It is an interesting observation that one can do isotropic reduction 
without appealing to 77- forms. 

Assume again that we are given a tuple {F, q, J, p) and an isotropic locally 
constant subsheaf X. Then we obtain an orthogonal decomposition F = / 0 (/^ 0 
/) 0 (F e here we denote by F 0 the orthogonal complement sub-bundle 
of I^ in F with respect to the metric J* o q. Note that J induces an isomorphism 
I = F Q I-^. There is a natural identification of bundles 0 / = Fj. The metric 
structure J restricts to 0 / and therefore defines a metric structure on Fj. 

We consider the Z-grading on F which is given with respect to the decom- 
position above by A" = diag(0, 1,2). The connection is upper-triangular with 
respect to this decomposition. Therefore, 

(3.3) := 

is regular at n = 0. In fact, 0 0 . The tuple (F, Vf , J) is thus 

isomorphic to the tuple obtained as follows: We consider the sum Fj0 (J0F/X“^) 
with associated bundle Fx 0 (/ 0 /) , metric structure 



0 



0 1 
6 0 



and connection 0 0 (V^)*. 

We now consider M = [0, 1] x M. Let pr: M — > M be the projection, F = 
pr*F, q := pr*g. On the corresponding bundle we consider the metric structure J 
which on {w} x M restricts to := 7/^ We decompose p(V^, J) —duf\^Fr, 

where r does not contain du and where 7: [0,1] ^ 0(M) is a smooth family 
of forms. By the discussion above, after shifting the rescaling from the metric 
structure to the connection we see that 7 is regular at 7/ = 0 so that we can make 
the following definition. 

Definition 3.21. We define 

p{T,q,J,I) ■= - [ l{u)du. 

Jo 
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If X is lagrangian, then it is easy to check that this definition coincides with 
the former Def. 3.7. Furthermore, note that 

dp{T , « , J, J) = p( ) - p( , J) . 

Next we consider isotropic reduction in stages. Assume that £ is a locally 
constant lagrangian subsheaf of T such that X C £. Then we obtain an induced 
lagrangian subsheaf Xj C Xj. 

Lemma 3.22. Modulo exact forms we have 

p{^, Q, J, = P(-A:, qi, -Cl) + p{T, q, J,I). 

Proof. We consider the orthogonal decompositions 

F = / © (L © /) © (/-^ © L) © (F © I-^) 

and the commuting Z-gradings M diag(0, 1, 1, 2) and K := diag(0, 0, 1, 1). 
Note that is upper triangular with respect to these gradings. Thus, if we 
define := , then this family of connections extends to 

(u, v) G [0, 1] X [0, 1]. We identify F = / 0 Fj 0 7 such that Fx = Q I and the 
last component is identified with F0/-^ by J. Furthermore, let be constructed 
as in (3.3) using Xj C Xj and . In this identification, we can write 

Vo,. = V^0Vf^0(VO*. 

We decompose F := 7 0 (L 0 7) and set N := diag(0, 1). Then we define := 
^-TVyL^iv identify F = L 0 F such that the second component goes to 

F 0 F via J. Then we can write 

V«.o = © (V^)*. 

Let us now consider the manifold M := [0, 1] x [0, 1] x M. Let F := pr*F and 
q = pr*^. We consider the metric structure J on F which restricts on {(u, u)} x M 
to u^v^Jv~^u~^. This works for uv ^ 0. Nevertheless, it follows from the 
discussion above after shifting the rescaling from the metric structure to the con- 
nection that p(X, J) is a closed smooth form on M. We decompose p(X, J) = 
dix Adn Acr + r, where r contains at most one of du, dv^ and a : [0, 1] x [0, 1] ^ Q{M) 
is a smooth family of forms. It follows from Stokes’ theorem and the structure of 
Vo,, and V.,o that 

d I a{u, v)dudv = qx, J^^,Cx) + p{T, q, J, J) - p{T, q, J, £), 

7[o,i]x[o,i] 

where the contributions come from the boundary components {u = 0}, {r’ = 1}, 
and {lA = 1}, respectively. This proves the assertion. □ 

Lemma 3.23. In Le{M) we have [X, g, J, p] = [Xj, gj, ,p + p(X, g, J,X)]. 

Proof. We consider the sheaf Q := T ^ Tx together with the form qg — 
q 0 {—qx)- We have the lagrangian subsheaf X of ^ which is the image of the 
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diagonal map X-*- X* 0 Xj. It contains the isotropic subsheaf X 0 0. We consider 
the metric structure J 0 —J^^. Then we have by Lemma 3.22 



[T, q, J, p] - \Tx, qi, J‘"^,p + p{J^, q, J, T)\ 

= [S, -p{^, Q, J, 2 :)] 

= [0,0,0,p{G,qg,J‘^,C)~p{J^,q,J,I)] 

= [Q,0,0,p{G,qg,J^,I) + p{Gx, {qg)j, , Ci) - P(^, g, 

Now note that p{Q,qg,J^,X) — p(jT, g, J,X) and p{Qx, {qg)x, , Cj) — 0. The 
reason for the first equality is that and preserve the decomposition G — 
X 0 Fj and that / C X 0 0. The second identity can be seen by noting that 
preserves the decomposition Gx = X j 0 J^^Lx- □ 



3.5. Functor ial properties. 

3.5.1. Homotopy invariance of pull-back. If /: M ^ TV is a smooth map of 
manifolds, then we obtain an induced map /* : Le{N) — ^ Le{M), which is given 
on generators by pull-back of structures. 

Lemma 3.24. /* only depends on the smooth homotopy class of f. 

Proof. Consider a generator (X, q^ J, p). Let {ft)te[o,i] a smooth homotopy 
of maps from M to N. Then we have an isomorphism (j): (/qX, f^q) (/i X, flq)- 
Let M := [0, 1] x M and H: M N he induced by (ft). We compute 

foP ~ fiP - /oV, = foP - f*iP - [ H*J) 

Jm/m 

= -d( H*p+ f dH*p- f p{V^'^,H*J) 

Jm/m Jm/m Jm/m 

= 1 (p(V^*^,H*J)-p(V"*^,HV))=0, 

Jm/m 

where = means equality modulo exact forms. It now follows from Lemma 3.10 that 
[/oX /o 9, /oV, /oV] = [/rx /iN, /iV, AV]. 

□ 



One can also check that the pull-back /* is compatible with the L{M) (resp. 
L(A^))-module structures. 

3.5.2. Exact sequences. We define natural maps M) ^ Z(M) and 

L{M) — > L{M) by [p] [0,0, 0,p] and [X, g, J, p] respectively. We 

consider R) as an L(M)-module such that every element of L(M) acts 

trivially. M) becomes an L(M)-module via the ring structure of R) 

and the homomorphism ch o b: L{M) R). 
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Lemma 3.25. We have the exact sequence of L{M) -modules 
— > L(M) — > L{M) — > 

Proof. It is obvious from the definition of the maps that the composition 
of two of them vanishes. Therefore, it remains to check exactness. We have the 
following commutative diagram 




> L(M) > L{M) > H^^{M,R). 

The upper sequence is exact by [21, Prop. 21]. The vertical maps are all surjective. 
It follows by diagram chasing that the lower sequence is exact at L{M). 

We now show exactness at L{M). Let {T,q,J,p) be given such that [!F,q] = 
0. Then there exists {Ti^qi) which admits a lagrangian subsheaf C\ such that 
® ® qi) also admits a lagrangian subsheaf C. We choose a metric struc- 

ture Ji and define pi such that [.^i, Ji, Pi] = 0. In fact we must take pi := 
— gi, Ji, £i). Lagrangian reduction by C shows that [F 0 © gi, J 0 

J\iP + Pi] = [0,0, 0,o;] for the form a; p + pi + p{F 0 .Fi, ^ 0 J 0 Ji, T). It 
follows that [F^ q^ J, p] = [0, 0, 0, co] comes from M). □ 

3.5.3. Injectivity of H^^^{M,R) -> L{M). 

Proposition 3.26. The map M) L{M) is injective. 

Proof. Let u g be a closed form. If [0,0,0, a;] = 0 in L{M), then, 

by Definition 3.8, there exists {F^ q, J, p) together with two lagrangian subsheaves 

Cl such that 

N = [p{^, g, JXo)~ p{^, q, J, C ,\ )] ■ 

We claim that \p(T, q, J, Cq) —p{T, q,J,£i )] is independent of J. To show this 
we consider the space M. of all metric structures and M := M x A4. Furthermore, 
let (F,q,p) := pr*{F,q, p). We define the metric structure J on F such that it 
restricts to J' on M x {J'}. Using the two lagrangian subspaces Ci := pv*C{ we 
define the closed form 



a :=p{J^,q, J , Cq) - p{T,q, J , Ci). 

The metric structure J provides an embedding ij\ M — > M, and we have 
ija — p{F,q, J, Co) — p{F,q, J, Ci). Since the embeddings Ij and Ij> for two 
metric structures J,J' are homotopic, the classes [i}a] and [ij^a] coincide. This 
proves the claim. 

We next claim that we can assume that CqHCi — {0}. Note that X := £q n£i 
is an isotropic subsheaf. The reduction (Fx^qx) admits two induced lagrangian 
subsheaves {Ci)x- We have by Lemma 3.22 that 

[p{J^, q, J, Co) - p{T, q, J, £i)] = [p{Ti, qj, J^^,{Co)x) - p{Tj, qj, ,(Ci)i)] . 
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Thus we can replace {T ^ q, J, p) by (^j, gj, ^ p p{!F, g, J,X)) and Ci by {Ci)x. 

Let us now assume that Lq Pi Li = {0}. Then (cf. e.g. [26, Prop. 2.50]) we 
can choose J such that JLi = Li_i, i = 0, 1. With this choice J, Co) — 

p{T, g, J, £i) = 0 so that [a;] =0. □ 

3.5.4. The transformation to K^J^-theory. We construct a natural transfor- 
mation 7 : L ^R/z' M be a manifold. Note that is a module over 

the ring K^{M) and, therefore, by b: L{M) — > K^{M), a L(M)-module. We in 
fact construct morphism of L(M)-modules 7 m : L{M) which depends 

naturally on M. 

To define this morphism on generators {T, q^J^p) we use the geometric def- 
inition of K^J~r^{M) in terms of generators and relations which was recalled in 
Subsection 3.2.2. 

We define 7 m: L{M) ^ K~I^{M) by 7 m[^,9,J,p] = [A:, 
where is the hermit ian extension of the metric J* o Q on F. 

Lemma 3.27. 7 m is well-defined and has the properties as stated above. 

Proof. Since 7 m is induced by an obvious homomorphism 7 m : L{M) 

of semigroups (which is natural in M) it suffices to show that 7 m is 
compatible with lagrangian reduction and that it induces a L(M) -module isomor- 
phism. The latter property we leave as an exercise. 

Let £ C .F be a locally constant lagrangian subsheaf. Then [JF, g, J, p] = 
[0, 0, 0, p 4- p{F, g, J, £)]. In K^^^{M) we have (using V® = 0 

V^) that 

[Fc,h^‘=,V^^’\p] = [Fc,fi^SV®,p + ch(V®,V^"'7 

= [L 0 L, © V^, p + p{F, q, J, £)] 

= [o,o,o,p + p(:£, 9 , J,£)]. 

This shows that 7 m is well-defined. □ 

As an immediate consequence of the definition we get: 

Corollary 3.28. The following diagram commutes: 

L{M) ^ L(M) 

1 1 

Kulz(M) » K°{M) 

It follows from Definition 3.1 of L’^/^(M) as a pull-back that: 

Corollary 3.29. There is a natural surjective map 

L{M) Z^/^(M). 
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4. Eta homomorphisms 

4.1. Introduction and summary. It is an interesting problem to detect 
non-trivial elements of Lg(M) for a manifold M. 

From the homotopy theoretic definition of there is a natural pairing 

® Ki(M) R/Z, 

where Ki{M) denotes i^-homology of M. In [20], Lott gave an analytic description 
of this pairing. If M is odd-dimensional and the X-homology class is represented by 
a Dirac operator, then its pairing with a class in given in the geometric 

picture can be expressed through spectral invariants of the corresponding twisted 
Dirac operator, in particular through the 77-invariant. In the present section we 
consider the K-homology class given by the signature operator, which leads to a 
homomorphism 

%/Z* ^ 

The latter pulls back to 

^E/Z. ^ R/Z. 

It further induces a homomorphism from L(M) to R/Z. 

The main objective of the present section is to refine the homomorphism to 
an R-valued one. From the analytic definition of 77^^^^^ it is quite obvious that it 
cannot be lifted to R since the relevant 77-invariants jump by integers if the kernels 
of the corresponding operators change. But the dimension of the kernel is not an 
invariant of the data given by the classes and 

However, in our special case we work with the signature operator and with 
fiat vector bundles. The kernels are tied to cohomology and thus have stronger 
invariance properties. Lott has defined a lift 77^°^^ : R. Unfortunately, 

this homomorphism does not factor over L{M). But we can analyze this failure in 
detail. These considerations lead to the definition of the extended groups 
e = ±1, fitting into exact sequences 

0 ^ Z ^ Lf (M) ^ Lg(M) 0. 

The homomorphism from L{M) — » R/Z lifts to a homomorphism 77: L^^{M) R. 

The extended groups are only defined for closed odd-dimensional oriented 
manifolds M. Note that they are not functorial with respect to smooth maps (only 
with respect to homotopy equivalences). But they admit extended secondary index 
maps. 



4-2. R/Z. 

4.2.1. The definition. Let M be an oriented 72-dimensional closed manifold. If 
we choose a Riemannian metric, then we can define the signature operator 
Assume now that n is odd. Then is a self-adjoint operator which induces a 
class e Ki{M), and which is independent of the choice of the metric. 
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Definition 4.1. We define ^/Zhy ;= {x, [M"‘s"]). 

Furthermore, we define ^ E/Z as the composition of with 

the natural transformation ^M/z* 

4.2.2. Geometric description ofrf^^j^. We fix a Riemannian metric on M. 
Let [F^, V^, p] G Then one can express in analytic terms. 

Let ; Q(M,E) Q{M^E) be the odd signature operator of M twisted by 

the bundle E. Then its p-invariant is given by 

viDT) 

Let L(V^^) E n(M) be the L-form of the tangent bundle TM equipped with 
the Levi-Civita connection Then we have 

rf/^{[E,h^,V‘^,p\) := [n{Df^)-2 [ L(V™) A/.], 

JM 

where [.] on the right-hand side takes the class in E/Z. Using the local variation 
formula for the p-invariant we see that this combination indeed is independent of 
the Riemannian metric and only depends on the class of [E, /i^, V^, p]. For details 
we refer to Lott [ 20 , Prop. 3]. 

Note that this homomorphisms cannot be refined to have values in E, since 
the dimension of the kernel of depends on the choice of the connection for 
the representative [E, V^, p]. 

4.3. E- valued r/- homomorphisms. Since the Zg-groups involve fiat bun- 
dles E = bundle (.F), the kernel of the twisted signature operator defined 

in (4.2) is isomorphic to the sheaf cohomology In particular, it is in- 

dependent of the choice of a metric structure. This eventually allows us to define 
E- valued p- homomorphisms. 

4.3.1. pLott^ start with describing the homomorphism p^ott . ^ 

E which has been defined by Lott in [ 21 , §3.3]. Let M be a closed smooth m- 
dimensional oriented manifold. The Z-graded vector space of real differential forms 
Q(M) carries the = (— — symmetric duality structure (cf. (4.4)) 

q{u^,u') := Aa;', 

where Nm denotes the Z-grading on Q{M). We fix the convention := 

A choice of a Riemannian metric and of the orientation on M induces 
the Hodge-* operator which is characterized by 

u) A *o;' = (cj,o;')pTMVol. 
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Here vol is the Riemannian volume element of We define the Nm~ 

compatible metric structure 

jM ^ j 

Let now (^, q) be e-symmetric. By ^(M, F) we denote the space of F- valued 
smooth forms on M, where F bimdle(F). If a; e 0(M) and (f) E C^{M,F), 
then we have a product a; 0 G Q{M^F). The space Q{M^F) carries the e^ 6 - 
duality structure 

(4.1) 

J M ^ 

It further has a natural Z- grading AT of length m. If is a metric structure 
on F, then ® cj)) := is a A^-compatible metric struc- 

ture on Q{M,F) (cf. Definition 3.14). Let be the twisted de Rham differ- 
ential on n(M, F) induced by the fiat connection on F. Let be the 

adjoint of with respect to this metric on 0(M, F). Then we have (d^)* = 

We now assume that m = —e mod 4, then e€m = 1- Then we define the self- 
adjoint operator (cf. [2, (4.6)], [7, (1.38)]) 

(4.2) := 

Definition 4.2. The homomorphism E is defined by 

77 L-^^(F, g, J, p) := rj{Dtn - 2 / L(V™) A p. 

JM 

By the argument in [ 21 , Prop. 24], is well-defined and independent of 
the choice of the Riemannian metric of M. It also follows from the definitions 
that the following diagram commutes: 

_ Lott 

^ R 

1 1 



4.3.2. Motivation of extended L- groups. A natural problem is now to lift the 
composition 

L,(M) ^ R/Z 

to a R- valued homomorphism “ 77 ” : L^{M) R. This problem could be solved by 
factoring over the quotient Z^°^^(M) L^{M). Unfortunately, this factor- 

ization does not exist in general. For this reason we will define modified L- and 
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L- groups which will be denoted by and Lf^. They fit into the diagram 
(4.3) 



F4»-e(M,K) — 


1 


— ^ Ll°“(M) — 
1 






i 

— > Lf(M) — 
1 


i 

— » Lf(M) — 
1 






i 

A(m) — 


i 

— ^ L,(M) — 





The advantage of Lf^ is that we can extend the homomorphism to an 
homomorphism 77: Lf^{M) — > M. The draw-back of the extended L^-groups is that 
they are not functors on the category of manifolds. 

4.4. Definition of the extended L-groups. 

4.4.1. Some linear algebra. Let F be a real vector space with a non-degenerate 
form r: V V*. We will call (V,r) a duality space. 

Definition 4.3. A Z-graded duality space of length n G Z is a triple (V, r, N)^ 
where r) is a duality space and A" is a Z-grading operator such that r“^oA*or = 
n-N. 

If {Vi,ri^ Ni), i = 1,2, are Z-graded duality spaces of length then their 
tensor product is a Z-graded duality space of length rii + n2- 

Let (F, r, N) be a Z-graded duality space of length n. Assume further that 
r is graded symmetric, i.e., r{v,w) = (— l)I^H^Ir(u;,u). Then we can define an 
€n := (— l)[^^-duality structure on V by 

(4.4) q { v , w ) := r [{- l )~^ 

Let M[— n] be the graded vector space which has M in degree n and 0 in all 
remaining degrees. The duality structure r induces a map of graded vector spaces 
f ; F 0 F M[— n] by v r{v, w ) . 

We now consider a differential d : V ^ F of degree one. It induces a differential 
on F (8) F by d{v ^ w) — dv <S) w (— l)l^lu (8) dw, where v is homogeneous of degree 
|u|. On M[— n] we consider the trivial differential. 

Definition 4.4. The differential d is called compatible with r if f : V <S>V 
R[— n] is a map of complexes. Equivalently, r{dv,w) -h (— l)l^lr(u, du;) = 0 for all 
V, w eV with V homogeneous of degree |u|. 

We now assume that d is compatible with r. Let H{V) denote the cohomology 
of (F, d). It is a Z-graded vector space. The map H{r) : H{V (8) F) ^ A(M[-n]) = 
E[— n] together with the Kiinneth formula H{V) (8) H{V) ^ H{V (8) F) induces a 
graded-symmetric duality structure rn on H(V). In order to see that this pairing 
is non-degenerate, note that im(d)^ = ker(d) and hence ker(d)-^ = im(d). 
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Let (V, r, N) be a Z- graded duality space of length n with compatible differ- 
ential d, where r is graded symmetric. Then we have a (— — symmetric 
form 

Q{v,w) := r((— 1) ^ 2 = q{v,dw). 

In particular, if V is finite-dimensional and (— = 1, then we can consider 
the signature of the quadratic form Q, 

Definition 4.5. r{V,r,N,d) := 2sign((5). 

Let J be a metric structure on {V,q). Let d*-^ denote the adjoint of d with 
respect to the scalar product g(., J.) induced by J. We have d*-^ = (— JdJ. 
Assume that (— = 1. Then we can form the self-adjoint operator D := 

Lemma 4.6. We have sign(D) = ^ -h (—1)’^+^) r(y,r^ N,d). 

Proof. By Hodge theory we can identify H{V) with H ker(d) D ker((i*-^). 
We decompose V into D-invariant subspaces V — im(d) 0im(d*-^) 0?f. The metric 
structure J maps im(d) isomorphically to im(d*^). Furthermore, for G im(d) 
we have q{DJx,JJy) = {—l)'^^^q{JdJx,y) = q{dJx,Jy) = (— Jy). 
Let P be the projection to im{d*'^). Then sign(D) = (l + (— sign(DP). 
For all x,y we have q{x, JDPy) = (— dy). Thus we have sign(DP) = 

Let (P, r) be a duality space with grading N of length n and compatible dif- 
ferential d. Furthermore, let . . . C C F^V C . . . be a decreasing filtration 

of the complex (V, d, N) by subcomplexes. Further we assume that there exists 
ub such that r{F'^V^ FW) = 0ify + y>n 5 . On F 0 F we consider the induced 
filtration F^(F 0 F) - ^ Let P5’^(F) be the corresponding 

spectral sequence (cf. [17, §3.5]). 

We filter R[— n] such that F^]R[— n] = R[— n] if s < and F^M[— n] = 0 for 
s > riB^ The map f is then a map of filtered complexes. We therefore obtain a 
morphism of associated spectral sequences, which we also denote by f. The target 
nj) is eaisy to describe. We have nj) = 0 for all s > 0, y, y except 

for y + y = n and p = tib, where = R. All differentials vanish. 

The Kiinneth formula for spectral sequences yields a map 

F^’^(F) 0 F^’'(F) FJ+"’^+'(F 0 F). 

If we compose this with the morphism of spectral sequences induced by r we 
obtain pairings r^: FJ’^(F) 0F^’^(F) -^Rifp + q-\-s + t = n and y + s = n^- In 
particular, we obtain a pairing on Eu{V) which is compatible with the Z-grading 
Ne^ (induced by N) of length n and has the same symmetry properties as r. 

The differential du is compatible with the duality structure Vu on Eu and the 
duality structure Vu^i Eu-^i is obtained from Vu by considering E^ei ns the 
cohomology of Eu as described above. If ro is non-degenerate, then so are the Tu 
for all u > 0. 
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Assume now that r is graded symmetric and (— = 1- Then the form 
Tu induced on Eu{V) is graded symmetric as well. If Eu{V) is finite-dimensional 
for u > z, then we define 

Definition 4.7. Ti{E^) \= Ylu>i'^{^u{y)^ru,NE^,du). 

4.4.2. Hypercohomology and spectral sequences. Let M be a smooth manifold. 
Let .7^ be a locally constant sheaf of finite-dimensional real vector spaces and 
(F, V^) be the associated flat vector bundle. We further assume that F is Z-graded 
by and has a differential v (cf. Definition 2.4). We use the same symbols in 
order to denote the corresponding parallel endomorphisms of F. The cohomology 
H of (F, v) is again a locally constant sheaf of real vector spaces with Z-grading 
Nh‘ 

There are two spectral sequences which converge to the hypercohomology 
H(M, (F, Np,v)) of this complex, the local-global spectral sequence and the hyper- 
cohomology spectral sequence. Let us take the soft resolution of (F, N, v) given 
by the twisted de Rham complex (D(M, F),d^ -h v) with the total Z-grading 
Em,f = Em + Ef- Its cohomology is naturally isomorphic to H(M, (E,Ef,v)). 
The two spectral sequences are associated to the two natural filtrations of this 
complex. 

We first describe the local-global spectral sequence which is associated to the 
filtration 

F) = '^ F). 

q>p 

We have = QP{M,F'^) and igd^ = v. [gEP’“ igE^’'^+\ The first term 

is given by igE^’'^ = and igd\ = d^ : igE^’’^ igEf'^^’'^. We obtain 

igE^'^ = The local-global spectral sequences is natural and finite- 

dimensional starting with its second term. 

We now describe the hypercohomology spectral sequence which is associated 
to the filtration 

FPQ{M,F) = 

q>p 

We have hcES’” = ^HM,F^) and hcdo = d^ : hcEl''' hcEf^’'^'^\ The first term 
is given by = H^{M,Fp) and hcdi := H{v): hcE^i’^ ^ where 

H{v) is induced by v. The hypercohomology spectral sequence is natural and 
finite-dimensional starting with its first term. 

Now assume that q is an e-duality structure on F such that Ep and v are 
compatible with q (cf. Definition 2.4). Let M be closed and oriented, and set 
m := dimM. On D(M, F) we define the ee^-duality structure ^m,f t>y (4.1). The 
differential dp = d^ -\-v and the total grading Em,f — Em + Ep are compatible 
with qM,F- As explained in Subsection 4.4.1. we obtain induced pairings on the 
spectral sequences. 
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We first consider the local-global spectral sequence. We put tib := m and 
obtain pairings 

igqr : (g) igE^^^ R 

forp-hg+5-ht = m+n andp-h5 = m. On igE^'^^igE^^ = F^) 

this pairing is just qm,f- In particular, it is non-degenerate. As in Subsection 4.4.1, 
the (— l)^'^^eem-symmetric form qM,F{x,{d^ E v)y) induces the corresponding 
(— l)^“*"^€€rri-symmetric forms on igEr. If = 1, and m is odd, then we can 
define 

Definition 4.8. igT2{E,q,NF,v) := T2{igE^). 

In the case of the hypercohomology spectral sequence we put ub = n. We 
have parings 

hcQr • hcE^'^ 0 IgEr^ R 

for p-f g + s-l-t = m-hnandp+s = n. On hcEQ'"^ <S> hcEq^ = 0^(M, F^)0O^(M, F®) 
this pairing is again just qM,F- In particular, it is non-degenerate. If ecm = 1, and 
m is odd, then we can define 

Definition 4.9. hcTi{T,q,NF,v) —ti{hcE^). 

Finally, we define 

Definition 4.10. 

r{E,q,NF,v) := hcTi{E,q, Nf,v) - igT2{E,q, Nf,v). 

4.4.3. Definition of Lf^{M) and Lf^{M). We fix closed odd-dimensional ori- 
ented manifold M. We assume that e G Z 2 is such that ecm = 1, where Cm •= 
(— 1)[^^] G Z 2 and m = dimM. 

Let (F, q) be e-symmetric and £ be a locally constant lagrangian subsheaf of 
T. Then we define an integer r(F, C) by the following construction. 

We consider the sheaf Q C ® E ® E j C. It carries a natural c-symmetric 
duality structure qg. Note that q induces maps qc'- E ^ {E j C)* and q^ic'- E j C 
£*. Then qg'. Q ^ Q* is given by 

/ 0 0 qT/c\ 

[0 q 0 . 

\qc 0 0 J 

A compatible Z-grading is given by Ng — diag(0, 1,2). We define a differential on 
G by 

/O 0 0\ 

vg ^ \i£ 0 0 , 

\0 -pr 0/ 

where ijr: C ^ E is the inclusion and pr : E E j Eis the projection. We introduce 

the sign to make the differential compatible with qg. We now define the following 
integer. 
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Definition 4.11. r{T,q,C) '■= r{Q,qg,Ng,vg). 

Lemma 4.12. If C has a lagrangian complement, then we have r{T,q,C) = 0. 

Proof. In this case the spectral sequences degenerate. □ 

We now define the group Lf^ (note that ecm = !)• First we define the semi- 
group of isomorphism classes of tuples (T,q,z), where {J^^q) is locally 

constant sheaf of real vector spaces with e-symmetric duality structure q and 
z The semigroup operation is given by the sum of the entries. Next we define 
an equivalence relation ~ generated by lagrangian reduction. Let (T , q, z) as above 
and C C T di locally constant lagrangian subsheaf. Then we require that 

{T, q, z) ~ (0, 0, 2 + t{T, q, C)). 

We extend ~ to the minimal equivalence relation which contains lagrangian re- 
duction and which is compatible with the sum. 

Definition 4.13. We define Lf (M) Lf (M)/ 

The semigroup is in fact a group. Let [J^,q,z] denote the class rep- 

resented by (T ,q,z). Its inverse is given by \T , —q, —z], since by Lemma 4.12 we 
have 

0 .F, ^ 0 -q, T) — 0. 

There is a surjective homomorphism Lf^{M) Lg(M) induced by {T, q, z) 
{T,q). Furthermore, there is homomorphism Z ^ Lf^{M) induced by 2 ; (0, 0, 2 ;). 

Lemma 4.14. The following sequence is exact: 

0 — > Z — > Lf (M) — > Le(M) — > 0. 

Proof. We must show that Z — > Lf^(M) is injective. This will be a conse- 
quence of the fact that ry: Lf^{M) ^ R is well-defined which will be proved below 
(cf. Lemma 4.19). □ 

Of course, there should be a purely algebraic proof of Lemma 4.14. Another 
open problem is to turn M — > into a functor. 

Using Lemma 4.12 we see that q) 1 -^ (.F, q, 0) defines a homomorphism 

Definition 4.15. We define by the following pull-baek diagram: 

Lf (M) ^ Lf (M) 

1 1 

L,{M) . Le(M) 

An element of Lf^{M) can be written as [T, q, J, p, z]. The following assertions 
follow immediately from the definition, Lemma 3.25, and Proposition 3.26. 
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Corollary 4.16. We have the exact sequences 

0 — . Z Lf{M) — > L,{M) — ^ 0 

and 

0 — ^ ^ Zf (M) — ^ Lf (M) — ^ 

By {T, q^J^p) ^ (^, g, J, p, 0) we define a morphism 
^Lott(^) ^ Xf (M). 

It is now easy to check that the diagram (4.3) commutes. 

4.5. Construction of iq: L^^{M) E. 

4.5.1. The Tf -invariant of a complex. Let c G Z 2 . We assume that M is a 
smooth closed oriented manifold of dimension m such that m is odd and ecm = 
1, equivalently m = — e mod 4. Let (T',q) be a locally constant sheaf of finite 
dimensional real vector spaces with 6-symmetric form. Let furthermore Np be a 
compatible Z-grading and 1 ; be a compatible differential. By {TL^qu) we denote 
the associated cohomology. We choose a Riemannian metric , a compatible 
metric structure , and let be the induced metric structure. Then we can 
define the operators and as in (4.2). The following theorem is the main 
ingredient in the construction of rj. Recall Definitions 3.15 and 4.10 of the ry-form 

Np, v) and of the integer r{T, q, Np, v). 

Theorem 4.17. We have 

riiDtn - = 2 / L(V™) A fj{T, Np, , v) - t{T, q, Np, v). 

Jm 

Proof. A sketch of the proof is given in Subsection 6.2. □ 

4.5.2. Definition and well-definedness of rj. Let [T^q, p, z] G Lf^{M). We 
choose a Riemannian metric . 

Definition 4.18. We define 

r]{T,q, J, p,z) := (T, q,J^,p)-z 

= rj{Dp '')-2 [ L{V™)Ap-z. 

JM 

Lemma 4.19. The map J, p, z) ^ r]{T,q^ p^ z) induces a well-defined 
homomorphism 77: Lf^{M) — ^ E. 

Proof. It follows from the well-definedness of ry^ott Prop. 24] that rj is 
independent of the choice of the Riemannian metric on M. It therefore suffices to 
show that (.Z*, q, J, p^z) ~ 0 implies that /y(Z^, g, J, p, z) = 0. Thus let Z C be 
a locally constant lagrangian subsheaf of T such that p -h p(Z^, q, J,C) = 0 and 
2 : + r{T,q,C) = 0. 
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We construct the complex {Q ^qg,Ng,vg) as in Subsection 4.4.3. Using the 
compositions Jl • L — > F F F/L and Jf/l • F/L — > F Q L L, we 



define the metric structure 

/ 


^ 0 


0 


Jl\ 


:={ 


0 


J 


0 . 


\ 


^Jf/l 


0 


0 / 


As in the proof of Proposition 3.16, 


we see that 


modulo exact forms 



Vid,Ng,J^,vg) = -p{T,q,J,C). 



By definition we have 

= T{g,qg,Ng,vg)- 

The complex Q is exact. By Theorem 4.17, we have 



7?(Z?^") = 2 / L{V™)Afi{g,Ng,J^,vg)-T{g,qg,Ng,vg). 

JM 



Thus 



q, J, p, z) = viDtn - 2 / Ap-z 

J M 

= 2 [ L{V™)Afl{g,Ng,J^,Vg)-T{g,qg,Ng,Vg) 

JM 

-2 / L(V^^)Ap-2 
JM 

\ f A{p{T,q,J,C) + P) - {z + T{g,qg,Ng,Vg)) 

JM 



= -2 



= 0 . 



□ 



5. The secondary index map 

5.1. Introduction and summary. In this section we consider the secondary 
index map (i.e., the wrong- way or push- forward map) for associated to fibre 
bundles. It is constructed by refining the geometric construction of This 

construction naturally involves ry- forms for fibre bundles. The proofs of the facts 
that Trf' is well-defined, and that it has nice functorial properties, are all based on 
the study of various adiabatic limits of these 77 - forms. We start this section with 
the introduction of the ry-form associated to a fibre bundle and the statements of 
the adiabatic limit results. Then we introduce the secondary index maps and dis- 
cuss their functorial properties. We give the algebraic parts of the proofs in detail 
using the corresponding adiabatic limit results. 
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5.2. Adiabatic limits of eta invariants, the eta form. 

5.2.1. Generalized connections. Let M be a smooth manifold and F ^ M he 
a smooth real vector bundle. Let V be a connection on F. Using the Leibniz rule 
we extend V to Q{M,F) (cf. [3, Def. 1.14]). 

Definition 5.1. A generalized connection on F is an operator A: F) 

n(M, F) of the form A = \/ F S with S e 0(M, End(F)). 

Let q: F ^ F* be a duality structure on F. We extend ^ to a form q : f](M, F) 
(8) fl(M, F) 0(M) by q{u x,w ^y) = u A wq{x, y). 

Definition 5.2. We say that a generalized connection A on fl(M, F) is com- 
patible with q if dq{(l),'i/j) = q{A(l),'ip) + q{(l),Aip). 

5.2.2. The rj-form of a fibre bundle. Let tt : M — ^ F be a smooth locally trivial 

fibre bundle with closed fibres 6 G F, of dimension n. Set = (— 1)^^^, = 

We assume that the vertical bundle TZ \= ker(dTr) C TM is oriented. 
Let (F, qjr) be a locally constant sheaf of finite dimensional real vector spaces over 
M with a e~symmetric duality structure qjr and let F be the corresponding flat 
vector bundle (cf. Subsection 2.4.1). 

We consider the infinite-dimensional Z-graded vector bundle Q{Z,F) B 
(with grading Nz by form degree) with fibre Q,{Z, F)t = such that its 

space of smooth sections on F is C^(M, A*{T* Z)^F). The space D(Z, F) carries 
an ce^-duality structure qz^r induced by qj- as in (4.1). Then the Z-grading Nz 
on 0(Z, F) is a compatible Z-grading of length n. 

Our next goal is the interpretation of the twisted de Rham differential d^ on 
fl(M, F) induced by the flat connection on F as a superconnection (cf. [12, 
§III (a)]). We choose a horizontal distribution M C TM, i.e., a complement 
to TZ. This choice induces an identification Q{M,F) = fl(F, f2(Z, F)). Then d^ 
can be viewed as a generalized connection (see Def. 5.2) on Q{Z,F). For a vector 
field X G C^{B,TB) we denote by G C'^(M, T^M) its horizontal lift. If 
ijj ® (j) ^ C°^(F, fl(Z, F)) C fl(M, F), then we set 

® 4> Lxhuj (f) F u; Z) 

where Lx^ denotes the Lie derivative. In this way we define a connection on 
fl{Z,F). We extend to Q,{B,ft{Z, F)) by using the Leibniz rule. Now we 

decompose (cf. [12, Prop. 3.4]) 

where d^^^ is the fibrewise twisted de Rham differential along the fiber Z and ir 
is the insertion of a tensor field T G (7^(M, A^(T^M)* (g) TZ). To be precise, 
h?{T^ M)* is considered here as a subspace of X^{T*M) and ir is interpreted as 
an element of C^(F, A^(T*F) (g)End(fl(Z, F))). It turns out that d^ is a (— 1)^^- 
superconnection of A^-degree one (cf. Subsection 3.4.4) which is flat because of 
o d^ — 0. 
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We can form the (finite-dimensional) cohomology which comes 

equipped with a fiat connection (cf. [12, §III (f)]) and a parallel ee^- 

duality structure te(z,F)- The sheaf of parallel sections of H{Z,F) is naturally 
isomorphic to H{Z, F) := tt{F) so that qH{z,F) corresponds to the form qu{z,F) *= 
'^{qz,F) on H{Z^F) (cf. Subsection 2.5.1 for notation). 

We now choose a vertical Riemannian metric onTZ and a metric structure 
on F. The vertical metric and orientation on TZ together induce a Hodge *- 
operator *: 0(Z) Q(Z) as in Subsection 4.3.1. We define a metric structure on 
n{Z,F) by 



(5.1) 







2 






This metric structure is compatible with the Z-grading Nz- On the cohomology 
H{Z, F) we obtain a metric structure induced by . Let (d^)*, 

(zt)*, (V^T^* the adjoints of d^T^ 2 t, respectively, with respect to 

the scalar product qz,F{', d'^T.) on Q{Z,F) defined by 

• If n is even, by an easy computation we see that d^ is compatible with 
qz,F in the sense of Def. 5.2. This in particular implies that the differential d^T 
is compatible with qz,F- Though fl{Z^F) is infinite-dimensional, the theory of 
characteristic classes and forms extends to certain nice super connect ions. In par- 
ticular, p(d^, ^ is well-defined. We consider the grading z'^ ’ 

Then the odd part of d^ with respect to this grading is given by 

A = ^ (d^ -h (d^)*). It is a -superconnection and we have 



(5.2) p(d^, exp(— t1^)] , 

here (p multiplies a p-form by (27ri)~^/^. 

We now introduce the rescaling. Let B := (0, oo) x B and pr: ^ ^ ^ be 
the projection. We consider the bundle M := pr*M over B together with the 
canonical projection Pr: M ^ M. We define {F,qjr^T^ M , J^) Pr*(J', 

We obtain the Z- graded ee^^-duality bundle Q{Z,F) over B with 
(_l)iVz -superconnection A' := d^, which is the twisted de Rham differential on 
rt{M, F) induced by V^. We fix the vertical metric which restricts to 
over {t} X M. It induces the metric structure J on 0(Z, F). The form p{A' , J) E 
n(H) is now well-defined as in (5.2). Let us decompose p(-A', J) = dt Ay-hr, where 
r does not contain dt. Here 7 : (0, 00 ) Cl(B) is a smooth family of forms on B. 
More precisely, for t > 0 we set 



Ct^ 









(5.3) 
Then 

(5.4) 



y{t) = — (27ri) ^/^pTr 
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By [21, Prop. 31], we have '^{t) = 0{t as ^ ^ oo and ^{t) = 0(1) as 
^ ^ 0 so that we can define ([21, Def. 33], [8, Def. 4.33]) 

Definition 5.3. fj{n{Z,F),Nz,J^^^ ,d^) := - 

Note that and M induce a canonical connection on TZ (cf. [5, 
Thm. 1.9], [3, Prop. 10.2]). Let L(V^^) G 0(M) be the L-form of TZ as in 
Subsection 4.2.2. We have 

(5.5) dfi{n{Z,F),Nz,J^’^,d^) = 

I L(V^^) A p{V^, J^) - 

• If n is odd, then A, + (V^’^)*) commute with To 

stay in the superconnection formalism we introduce an extra odd variable a such 
that cr^ = 1. We multiply all components of A with even form degree of A{T*B) 
by this variable and denote the result still A. This modified A is then again a 
superconnection (cf. [ 9 , §II (f)]). 

If Bq,Bi are trace class in End{ft{Z , F)) , luq,uji g A(T*B), we put 

(5.6) TrJ^ [^qBq + toiBicr] := ujq Tr [Bq] , Tr^j [ujqBq + uJiBicr] cui Tr [Bi] . 

By [ 9 , Thm. 2.10], the form 

(5.7) p(A', J) = (2z)^/^(pTra[z^^’^ exp(-A^)] 

is a closed odd form. Let us decompose p(A',J) = dt F where r does not 
contain dt. Then 

(5.8) 'y{t) = z'^^’''{^Ct)exp{-C^) . 

By the same argument as in [10, Thm. 2.11], we have j{t) = 0(1) as t — > 0 as well 
as j{t) = 0(t“^/^) as t ^ oo as in [3, Thm. 9.23]. So we can define (cf. [8, Def. 
4.93]): 

Definition 5.4. r)(D(Z,F), := - ^{t)dt. 

Then the degree zero part of ^ is | for the fibrewise operator in 

(4.2). By the argument in [9, Thm. 2.10], as in [8, Thm. 4.95] we have 

(5.9) dTj{Q{Z,F),Nz,J^’^,d^)= [ L(V^^)Ap(V^,J^). 

Jz 

Since the fibres Z are odd-dimensional, we must specify our sign conventions when 
integrating differential form along the fibres Z.lia e f^(B), (3 a section of A{T*Z) 
on M with compact support, then 7r*(a) A = a j3. This sign convention is 
compatible with the sign convention of Tr in Subsection 3.4.4 and (5.7). 
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Remark 5.5. Assume that n is odd. In [21, (233)], Lott defined also an even 
form Actually, = 0. In fact, we only need to 

show J^(l)) = 0. Set A = {A — If we use our notation, 

^ exp(-A 2 )] 

Now A preserves the parity of the A^^-grading, while changes the parity 

of the -grading. Thus the above trace must be zero. It also follows from this 
observation that the eta form in [21, (238)] is zero if n is odd. 

We now describe how fj(Q{Z^ F), Nz, ,d^) depends on its arguments. 
Let {T^ , J^), {T' ^ ^ j'^) be two triples of geometric data. We will 
mark the objects associated to the second triple by '. 

Let Z(TZ, V ^^) be the transgression of the L-form such that 

di{TZ, V ^^) = L(V^^) - L(V ^^). 

Theorem 5.6. Modulo exact forms on B, we have 

fj(Q(Z, F), Nz, J^'^, d^) - fi{^{Z, F),Nz, d^) 

= / i(TZ,V^^,V'^^)Ap(V^,J^)+ [ L(TZ,v'^^)Ap(V^,J^V'^) 

Jz Jz 

Proof. Note that if n is odd, changes the parity of the A^-grading 

on A(Z, F), thus . . .) are zero. Now this equation 

is a formal consequence of (5.5) and (5.9). □ 

5.2.3. Adiabatic limits and the formula of Dai. We keep the notation which 
was introduced in Subsection 5.2.2. Furthermore, we assume that dim.Z := n is 
even and that B is closed, oriented, and of odd dimension ns such that — 1* 

We choose a Riemannian metric g^^ on the base B. Using the horizontal distribu- 
tion M, we define the family of Riemannian metrics g™ 7r*g^^ 0 ^g^^ , 
T > 0. The orientations of B and TZ induce an orientation of M. Let := 
be defined as in (4.2) using the metric g™ and let g(D^) be its 77 -invariant. On 
the base B we consider the twisted signature operator := and 

its 77 -invariant 77 (F^^^’^^) with respect to g^^ , 

There is a decreasing filtration of the cohomological group H{M,F) and a 
Leray spectral sequence {LsEr,Lsdr) {v > 2) with = HP{B,W{Z,F)) con- 

verging to GrA*(M, F). In the present smooth model this spectral sequence is asso- 
ciated to the filtration of F(M, F) given by F^fl{M, F) = 0 q>p 7 r*O^(F, D{Z, F)) 
(cf. [17, §3.5]). Then lsEq'^ = F^(F, F^(Z, F)). The induced 1-symmetric pairing 
0 lsEq^ -^R, p + g + s + t = dimM, p F s = Nb = dimF, is given 
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by (4.1). In particular, it is non-degenerate. This spectral sequence with duality 
structure gives rise to the integer ls'^ 2 {^^F) T 2 {lsE^) as in Definition 4.8. 

Let be the Levi-Civita connection on TB. Let L(V^^) be the corre- 
sponding L-form on TB, We can now state the main result of [16]. 

Theorem 5.7 (Dai [16, Thm. 0.3]). 



lim riiD^) — 

T^oo 

f L{V'^^)Afi{niZ,F),Nz,J^’^,d^) + LS,FT2{Z,F). 

JB 



5.2.4. The rj-form and complexes. We make the same assumptions as in Sub- 
section 5.2.2. In addition we assume that T admits a Z-grading Nf of length np 
and a compatible differential v. Let H be the cohomology of v. Let H be the fiat 
vector bundle corresponding to TL. 

We choose a metric structure on F such that it is compatible with Np- 
Then we obtain an induced metric structure on H. 

We modify the construction of the eta form in Subsection 5.2.2 by replacing 

by d d^ + v. This differential is now a flat (— l)^-superconnection, where 
N := Nz + Np is the total grading. Here N is a grading of length n F np which 
is compatible with the form qz,F- 

The cohomology of the zero part d^^^Fv of d is the fibrewise hypercohomology 
HH of the complex {F, v) along the fibre Z. By HH we denote the corresponding 
bundle which acquires an metric structure induced by 

We now introduce the rescaling. Let again B := (0, oo) x B and B B 
be the projection. We consider the bundle M pr*M over B together with the 
canonical projection Pr: M ^ M. We define {F,qp,T^ Np) := FF{F,qp, 
T^ M^v, Np). We obtain the (by N := Nz + Np) Z-graded ecn-duality bun- 
dle Ft{Z,F) over B with the (— l)^-superconnection A' d = d^ -\- v. We fix 
the vertical metric which restricts to over {^} x M. Furthermore, 

we consider the metric structure which restricts to ^-^F/ 2 +nir /4 jF^AF/ 2 -niF /4 
= j^t^F-nF /2 Definition 3.14) on {t} x M. These choices induce the metric 
structure J on Ft[Z,F). The form p{A' ^ J) G Fl{B) is now well-defined as in Sub- 
section 5.2.2. Let us decompose p{A' ^ J) = dt A 7 + r, where r does not contain dt. 
Here 7 : (0, 00 ) Q{B) is a smooth family of forms on B. 

Lemma 5.8. We have y(^) = 0(t~^/^) ast^oo and 7 = 0(1) ast—^0. The 
form 
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satisfies 

dfi{n{Z, F),N, 

( L(V^^) A p(V^, J^) — if n is even, 

I L(V^^) A p(V^, J^) if n is odd. 

Proof. This lemma can be shown using the techniques of the proof of [12, 
Thm. 3.21], [ 9 , Thm. 2.10]. □ 



There are two spectral sequences of locally constant sheaves of finite-dimen- 
sional real vector spaces which converge to the hypercohomology HH of {T^v) 
along the fibre Z, namely the fibrewise hypercohomology spectral sequence 
{hc^rihcdr) ^nd the fibrewise local-global spectral sequence {igSr.igdr). Both are 
obtained from filtrations of Q(Z, F) which are compatible with the duality. There- 
fore, we obtain ee^ duality structures ^igEr- induced by qz,F- Let 

^giEr Le the Z-gradings on hcFr^giEr induced by N. We further obtain corre- 
sponding metric structures J^cEt ^ \y^ adjoint of hcdr with 

respect to J^cEt^ identify hc^r{HH) = hc^oo and igGr{HH) = igSoo (cf. Sub- 
section 4.4,2). 

To consider the case of even and odd n in parallel we adopt the following 
convention. If n is even, then the eta form of a complex or a filtration was defined 
in Subsections 3.4.4 and 3.4.5, respectively. 

If n is odd, then we proceed as in (5.7). Note that hcdr + hcd* commutes with 
jncEr^ We form hcA := By [ 7 , Prop. 2.12], [ 27 , §5], 

the form 

(5.10) + hcdr, \= exp(-/,c^^)] 

is an exact odd form. To define the 77 -form fj{hc^r, ^hcEr^ , hcdr) we now 
employ the usual rescaling induced by the Z-grading As in [ 8 , Thm. 2.43], 

[ 7 , Thm. 2.17], it is a closed form on B, and its cohomology class is ^ [ch{hcEr,>o) ~ 
ch{hcEr^co)], where hcEr,>o and hcEr^<o are the sub-bundles of hcEr associated 
to positive or negative eigenvalues of {hcdr + hcd*)- In a similar manner we 

define f}{igSr,N^^Sr^ ^igdr) associated to the local-global spectral sequence. 
We do not change the definition of the 77 -forms of the filtrations. 

The following theorems are the main ingredients of the proof of well-defined- 
ness of the secondary index map. 

Theorem 5.9. Modulo exact forms on B we have 

miz, F), N, = fi{n{Z, F), Nz, 

+ ahcSr, - VinH, hcGviHH), E^, 

r>l 
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Theorem 5.10. Modulo exact forms on B we have 
F),N, = fiiQiZ, H), Nz,J^'^,d^) 

r>2 

+ [ L{V^^)Afi{F,NF,J^,v). 

Jz 

The proof of both results will be sketched in Section 6. Note that if ni?’ is odd, 
then r]{n{Z,F),Nz,J^’^,d^) = 0 and ri{n{Z,H),Nz,J^’^ ,d^) = 0, as 
changes the parity of iVi?-grading. 

5.2.5. The rj-form of an iterated fibre bundle. Let W, V, S be smooth man- 
ifolds. Let 7Ti : LL ^ y , 7T2 : T — > 5 be smooth fibrations with compact fibres 
X and T, respectively. Then tts = 7T2 o tti : W S is & smooth fibration with 
compact fiber Z of dimension n. Let no = dim X, mo = dimT. Let TX,TY,TZ 
be the corresponding vertical tangent bundles. We assume that TX, TT, TZ are 
compatibly oriented such that we have an iterated fibre bundle with compatible 
orientation as in Subsection 2.5.2. 

Let X be a locally constant sheaf of finite dimensional real vector spaces over 
W with a €-symmetric duality structure qjr. We choose a metric structure on 
F := bundle (^). 

By taking fibrewise cohomology we obtain locally constant sheaves of finite- 
dimensional real vector spaces 7i{X,F) over V, and H{Y,?i{X,F)) and H(Z,F) 
over S. These come with induced duality structures qn{x,j^) ? Qn(z,:F)^ Q 7 i(Y,n{x • 

We choose horizontal sub-bundles T^W, i.e., complements in 

TIT, TV, TW to TX, TY, TZ. Furthermore, we choose vertical metrics , 
gTX ^ gTY py obtaiu iuduccd metric structures 

jH{Z,T) jH{Y,H{X,T)) 

Let be the connections on TX, TY , TZ which are induced 

by the choice of horizontal subspaces and vertical metrics (cf. [5, Def. 1.6], [3, 
Prop. 10.2]). We get a further connection := tt^ 0 on TZ = 

TX © {T^W n TZ). Let L(V^^), L(V^^), L(0V^^) be the associated 

L-forms as in Subsection 5.2.2. By L{TZ, we denote the transgression 

T-form such that 

(5.11) di{TZ, 

Since the fibre Z has the structure of a fibre bundle, we have a fibrewise 
Leray spectral sequence LS^r) > 2) of locally constant sheaves on S (cf. 

also [24, Prop. 2.1]). All terms have ecn-duality structures q^^gSr induced by qz^F 
on Qs[Z,F). The Z-gradings (induced by Nz) and the differentials Lsdr 

are compatible with the duality. In particular, we have ls ^2 = H(Y,H{X,F)). 
Hence, we have an induced compatible metric structure jH{y,h{x,f)) ^ 

Since the other terms are obtained by taking cohomology successively, we get 
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induced metric structures on is^r for all r > 2. Thus we can define 

fjiLS^r, , Lsdr) (with the usual modifications if one or two of the 

dimensions no, mo are odd, see the remark below). 

There is a filtration on H{Z,T) and a natural isomorphism GrH{Z,T) = 
LS^oo’ Therefore, we have the form fj{H{Z,T), ls^oo, jlsE^o^ in Def- 

inition 3.18. 

The following theorem provides the relation of the 77 -forms of the total fibration 
TTs with the 77 - forms of the partial fibrations tti and 7 T 2 . It is the main ingredient 
in the proof of the fact that the secondary index map is functorial with respect to 
iterated fibre bundles. 

Theorem 5.11. The following identity holds modulo exact forms on S: 



+ ^(0(T, H{X, F)),Ny, jTff (X-?")) , d^{x,r) ^ 

00 

+ '^ViLsSr, r Lsdr) 

r=2 

+ J L(TZ,V'^^,“V^^) Ap(V^, J^)- 

Proof. The proof of this theorem will be sketched in Subsection 6.5. The for- 
mula above arrises from a detailed investigation of the adiabatic limit of fj{Q{Z, F), 
TVz, □ 



Remark 5.12. Theorem 5.11 has four cases. Assume first that n is even. Then 
fi{ft{Z, F), . . .) and fj{LsTr, • • •) are defined as in Definitions 5.3, 3.15. If uq is even, 
then fj{Q.{Y,H{X,J ^)), . . .), fj{Q{X,F ), . . .) are defined as in Definition 5.3. If no 
is odd, then F(X,F)), . . .), f]{tt{X,F ), . . .) are defined as in Definition 5.4 

and r)(n(y, F(X,F)), . . . ) is zero by the remark following Theorem 5.10. 

Assume now that n is odd. Then f]{Q{Z, F), . . .) and rj{Ls^r, • • •) are defined as 
in Definition 5.4 and Subsection 5.2.4. If no is odd, then f}{Q.{Y, H{X, F)), . . .) and 
rj{Q{X, F), . . .) are defined as in Definitions 5.3 and 5.4 and rj{Q{Y, H {X ^ F)), •) is 
zero by the remark following Theorem 5.10. If no is even, then fi{Q{X,F ), . . .) is 
defined as in Definition 5.3 and fj{Q{Y,H{X, F)), . . .) is defined as in Definition 5.4. 
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5.3. Definition of the secondary index maps. 

5.3.1. The map Let M ^ B be a smooth locally trivial fibre bundle 

with even-dimensional closed fibres Z over a compact base B such that the vertical 
bundle TZ is oriented. We set n := dimZ, = (— 

In [ 21 , §3.6], Lott constructed a secondary index map 



^L,Lott: 

which fits into the commutative diagram 



r Lott 



(B) 






(M) 






L ,Lott 

Lit(B) 



^£,nt/z| 



KukiM) 



sign,R/Z 






We recall the definition of We choose a metric and a horizontal 

distribution M. This fixes a canonical connection on the vertical bundle 



TZ. 



Definition 5.13. Given a class [.F, ^ its secondary 

index is defined by 

jF^^jLott 

\h{Z, T), qniz,^) , ^ L(V^^) A P - fjin{Z, F),Nz, d^)] 

By [ 21 , Prop. 32], is well-defined. In particular, it is independent of 

the additional choices. 

5.3.2. Construction ofn^. We can now define the secondary analytic index 
map 

Recall that we have surjective homomorphisms 

_ 4(M), ^ LeeAB)- 

Definition 5.14. We define by the condition that the following diagram 
commutes: 

_ L,Lott _ 

1 _ "l 

L(M) 4e„(B). 

Theorem 5.15. The index map induces a well-defined secondary index 

map 
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Proof. Let [.F, gjr, J^,p] G L^{M) and £ C ^ be a locally constant la- 
grangian subsheaf. We must show that 

(5.12) \h{Z, Ap- ^{2, F),Nz, d^)] 

= [0, 0, 0, ^ L(V^^) A (p + p{F, J^,C))] ■ 

We repeat the construction of Q, qcG^ ^ vg, etc. from Subsection 4.5.2 to write 

(5.13) -p{J^,qyr,J^,C) =v{Q,Ng,J^,Vg). 

We consider the sum 0 together with the corresponding form and metric 
structure. Note that 

[H{Z, g°) © n{Z, g% qn(z,go)^n(z,g-) , , O] = 0. 

Moreover, we have f)(n(Z, G° © G^), Nz, jG°<bg^ ^ 0. Thus 

[n{Z, T), L{V^^) A P - fi{n{Z, F), Nz, d^)] 

= \h{Z, F),qH(z,rpJ^^^'^^ , ^ L{V^^) A p - f,(^{Z, F),Nz, d^)] 

+ [n{Z, g°) © n{Z, g^), qn[z,go)emz,g ^) , , 0 ] 

= [h{Z, g),qHiz,g),J”^^’^\J^ A P - v{n{Z, G),Nz, J^'°, d"^)] . 

Next observe that we have TL{Z^Q) — hc^i- This relation respects the other struc- 
tures. Let HH be the fibrewise hypercohomology of the complex Q along the fibre 
Z. Using Lemma 3.16 repeatedly and finally Lemma 3.19, we get 

\h{Z, F), qHiz,n,J^^^'^^ , ^ A P - fj{n{Z, F), Nz, 

= [hc£2,q,^e, , , £ T(V^^) A p - miZ, G),N z, d°) 

5 /icdl)j 

= [hc£oo,q,,^e^ , ^ A p - fi{n{Z, G),Nz, , d^) 

~ ^ Vjhc£r, d^hc^r y ^)/icdr)j 

r>l 

= [hH, quH, L{V^^) A p - fj{n(Z, G), Nz,J^’^, d«) 

- \^Er, J^‘^\hcdr) + mn, hcGvinH), . 

r>l 
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(Note that in fact TiH = 0.) We now apply first Theorem 5.9 and then Theo- 
rem 5.10 to conclude that 

J z 

= \hH, q-HH, ^P- G-)- N, j^’^, d)] 

= [HH,qnH,J^^,j L{V'^^)A{p-f,{g,NG,J^,vg)) 

- Y. N,^E^,F^^-,igdr) + f,{HH, IgGAUH), 

r>2 

Remark that in this case, igEr = 0 for r > 2 and HH = 0, as ^ is a short 
exact sequence. By (5.13) and the above equation, we get (5.12). The proof of 
Theorem 5.15 is complete. □ 



5.4. Functorial properties. 

5.4.1. Compatibility and naturality. The following two propositions are imme- 
diate consequences of the definition of the secondary index map. 

Proposition 5.16. The following diagram commutes: 

i/4*-^(M,R) > Le{M) > L,(M) 

^sign 

Proposition 5.17. The secondary index map is natural with respect to pull- 
back of fibre bundles, i.e., given f : B' ^ B we consider the pull back 

f*M — ^ M 
B' — ^ B, 

where f*M B' has the induced fibrewise orientation, and we have {f*'^)i ofT = 
Font 




5.4.2. Functoriality. We adopt the notation of Subsection 5.2.5. In particular, 
we have smooth fibre bundles tti : W P, 7T2 : P — ^ -S' with closed fibres X, Y. 
The composition tts = 7T2 o m: W S' is a fibre bundle with closed fibre Z. Let 
n = dim Z, no = dim X, mg = dim Y such that n = no + mg. We assume that n, ng 
are even. Furthermore, we assume that the relative tangent bundles TX, TY, TZ 
are compatibly oriented. 
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Note that = eno^mo- We have well-defined secondary index maps 

4,*: Ae„„(O^Ae„(5). 

Theorem 5.18. We have the equality of homomorphisms L^{W) L^^^{S): 

° 

Proof. Let , p) represent some element of Le(W'). Then the ele- 

ment TTg g:r, p] is represented by 

[h{Z, T) , qn(z,^) , £ L( A p - f,{n{Z, F),Nz, d^)] - 

There is a filtration of H{Z,T) such that the corresponding graded sheaf is the 
limit LS^oo of the fibrewise Leray-Serre spectral sequence. Using Lemma 3.19, we 
get 

= [n{Z, F),qH(z,n , L{V^^) A p - i){n{Z, F),Nz, d^)] 

= [ls^oo, g.s£oo L{V^^) A p - fj{^l{Z, F),Nz, J^’^, d^) 

Note that H(Y^H{X^!F)) — ls ^2 with all induced structures. Next we use Lemma 
3.16 several times to get 

L(V^^) A p - f,{^{Z, F),Nz, d^) 

oo 

- vimz, F), Lsfoo, N^^E.,J^^^’~,Lsdr)] • 

r=2 

Now we start with the other side. We have 

= [n{X,F),qn(x,^),j'^^^’^\ f LiV^^)Ap-rj{n{X,F),Nx,J^’^,d^)]. 

J X 
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Furthermore, we get 

0 J^,p] 

= [n(Y, H{X, ^)), 

+ A A p - fj{n{X,F),Nx,J^’^ ,d^)^ 

- n(n(Y, H{X, x)),Ny, jYH(x,n^ . 

Thus the assertion of the theorem is proved if we show that 

(5.14) ^ L(V^^) A p - F),Nz, 

oo 

- v{niZ,F),LsS^,J^^^’^\j^^^-)+J2fl{LsSr,N,,Er,J^‘^^\Lsdr) 

r=2 

= L(V^^) A L(V^^) A p - r)(fi(X, F), Nx,J^’^, d^)^ 

- p(Q(Y, H{X, F)), Ny , 
modulo exact forms. Note that we have 

J L(V^^)A j L(V^^)Ap 

= [ 7r2L(V'^’^) AL(V^-^) Ap 

Jz 



= j Ap-dL(rZ,V'^^,°V'^^) Ap) 

= j {L{V'^^)Ap-L{TZ,V'^^°X'^^)Ad(^ 

= j (^L(V^^)Ap-L(TZ,V^^,°V^^)Ap(V^,J^))- 

Using this identity, we see that (5.14) is equivalent to 
- fj{n{Z, F), Nz, J^’^, d^) - f,{n{Z, F), LsSoo. 

oo 

+ LS^r’t 1 Lsdr) 

r=2 

= -J L(rz,v^^,‘*v^^) Ap(v^,j^) 

- j L(y^^) Afj{^l{X,F),Nx,J^’^,d^) 

- fj{Q(Y, H{X, F)), Ny, JYH(x,t) ^ ^Y,Hi,x,^)y 
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The latter relation, however, is exactly the assertion of Theorem 5.11. □ 



5.5. The index map for Lf^ and 

5.5.1. Definition, Let tt: M B be a fibre bundle with even-dimensional 
closed fibres Z of dimension n. We assume that the relative tangent bundle TZ 
is oriented. Furthermore, we assume that B is closed, oriented, and of dimension 
m such that = 1 and m is odd. Let qjr) be a locally constant sheaf of 

finite-dimensional real vector spaces on M with an e-symmetric duality structure 
qjr. Recall from Subsection 5.2.3 that in this situation we have the Leray spectral 
sequence Lsdr) {t > 2) of finite dimensional vector spaces which carries 

induced duality structures q^sEr- If gives rise to the integer 

LST 2 {Z,F) := T 2 {lsE^) := "^r^LsFr.qLsEr^ ^LsEr^ Lsdr)- 

r>2 

Definition 5.19. (1) We introduce the extended primary index map : 
Lf(M) - by 

(2) We introduce the extended secondary index map by 

, p,z] \= \^{Z,F),qq-c{z,T)^ 

L(V^^) A p - 7?(0(Z, F),Nz, d^),z- lsT2{Z, F)] . 

Theorem 5.20. and are well-defined. 

Proof. Let Trf" : Lf (M) ^ (^) ^ 

by the above formulas. 

Lemma 5.21. We have 

,p,z)) = t]{F,qjr,J^,p,z). 

Proof. This is just a reformulation of Theorem 5.7. In fact, since the 77- 
homomorphism of Definition 4.18 is independent of the metric, we can perform 
the adiabatic limit and obtain (using that in this limit L(V^^) ^ 7 t*L(V^^) A 
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L(V'^^) (cf. [24, Thm. 5.1])) 

■q{T, qr, J^, p, z) = r]{Dp^’^) - 2 j L( V"^^) A p - z 

= '7(^S,^)) + 2 / L{V^‘^)Afi{n{Z,F),Nz,J^’^,d^) 

*J z 

+ lsT2{Z, F)-2 [ L{V^^) A / L(V^^) Ap-Z 
J B J Z 

^ L(V^^) A p - p(n(Z, F), iVz, d^) , 2 - isT2(^, F)) 

□ 



Lemma 5.22. is well-defined. 

Proof. Assume that J, z) e Lf^{M) satisfies p, z) ^ 0. 

Then we have [T, qp^J,p] =0 in L^{M). Since tt^ is well-defined, we have 7 t^([.F, 
qF,J,p]) = 0. By an inspection of the definitions we further observe that 
qr, J, p, z) ~ (0, 0, 0, 0, u) for some u ^ Z. We must show that = 0. In fact, since 
the p- homomorphism is well-defined, we can compute (using also Lemma 5.21) 

0 = Qf, j, P, z) = (^, 9f, j, P, z) = p(0, 0, 0, 0, u) = -u. 



□ 



Lemma 5.23. is well-defined. 

Proof. Let G Lf^(M) satisfy (T,q,z) ~ 0. Then we can find a 

metric structure and a form p such that (.F, qF,F,P,z) ~ 0 in Lf^{M). It 
follows from Lemma 5.22 that 

j^,p, z) ~ 0 . 

This implies q, z) r^{). □ 

Remark 5.24. The assertion of Lemma 5.23 should have a purely algebraic 
proof. In particular, such a proof should be independent of analytic results about 
p-invariants and p-forms. We were not able to find such an argument. 

The proof of Theorem 5.20 is now finished. □ 

Let us state as a corollary the following consequence of Lemma 5.21. 




SECONDARY INDEX 



321 



Corollary 5.25, The following diagram commutes: 

Zf(M) — ^ K 




R. 

5.5.2. Functoriality. We adopt the notation and assumptions of Subsection 
5.4.2. In addition we assume that S is compact, the dimension ns is odd, and 
ecn^ns — 1 - We have well-defined extended secondary index maps 

ttI;; : Lf{w) ^ X- (5) 

<;:Z-^(F)^Z- (5). 

Theorem 5.26. We have the equality of homomorphisms L^(W) 

^3,* — ^2,* ^ ^1,* • 

Proof. Let [T^qjr^J^^p^z] c L^{W) be given. Then we have in view of 
Theorems 2.22 and 5.18 

- (ttL = 0. 

Thus 

-:P,z\) - (7rf7 0 7rfr)([^,g;r, = [0,0,0,0,«] 

for some u e Z. We must show that u = 0. We again use the 77 -homomorphism 
and Lemma 5.25: 

—u — 77 ( 0 , 0 , 0 , 0 , u) 

= v{[^, qj^, p, q:F, p, z])) 

= v{[^^qr,J^ ,P,z\) -•q{[T,qj^,J^,p, z]) 

= 0 . 

□ 

Remark 5.27. We conjecture that we also have 

r ex r ex r ex 

^3,* = OTTi^, . 

There should be a purely algebraic-topological proof of this identity. This together 
with Theorem 2.22 would again imply Theorem 5.26. Unfortunately, we were not 
able to find such a proof. The difficulties are very similar to the problems in an 
algebraic approach to Lemma 5.23. 
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In fact, we could conclude the well-definedness and the functoriality of tt^ 
from a combination of these hypothetical algebraic-topological results with Dai’s 
formula for adiabatic limits of 77 -invariants and the well-definedness of the rj- 
homomorphisms. In this case we would obtain an independent verification of the 
adiabatic limit results for 77 - forms. 

6. Adiabatic limits - sketches of proofs 

6.1. Remarks. This section contains the proofs of the assertions about adi- 
abatic limits of 77 -forms and invariants which were formulated earlier. The general 
techniques were developed mainly in the work of Bismut and coworkers, but also 
by Dai and others. Unfortunately, the details were worked out in specific cases 
which are similar to the situations of the present paper, but not exactly the same. 
In order to show the results needed in the present paper one can use the methods 
after adaptation. 

We decided to choose for the present section a coarser level of detailedness 
of our arguments. While Subsection 6.2 is still rather detailed, in the remaining 
subsections we just stated the main intermediate results with references to the 
literature, where proofs of similar results in slightly different situations can be 
found, which can be adapted to the present cases. It is not by coincidence that 
the formulations of these intermediate results in the last three subsections almost 
agree. 



6.2. The proof of Theorem 4.17. Let e G Z 2 . We assume that M is a 
smooth closed oriented Riemannian manifold of odd dimension m such that ee^ = 
1, i.e., m = —€ mod 4. Let qj^) be a locally constant sheaf of finite-dimensional 
real vector spaces with e-symmetric form. Furthermore, let Np be a compatible 
Z-grading of length np and 7; be a compatible differential on T. By {H^qu) we 
denote the associated cohomology. We choose a compatible metric structure 
on F and let be the induced metric structure on the cohomology H. Then 
we can define the operators and as in (4.2). In the present section we 
sketch the proof of the following formula. 

Theorem 6.1 (Theorem 4.17). We have 

viDp'') - ri{D%n = 2 [ L(V™) A Np, J^, v) - t{T, q^, Np, v). 

Jm 

Proof. We are going give a detailed sketch of the proof. The methods have 
been developed in connection with similar questions about analytic torsion (forms) 
and for the study of adiabatic limits of 77 -invariants. The proof of Theorem 4.17 is 
achieved by adapting these methods correspondingly to the present situation. 

We abbreviate D := Let be the metric structure on Q{M^F) 

induced by and the Riemannian metric as in Subsection 4.3.1. We proceed 

with V in the same manner as we did for to define D. We introduce W 

jM,Fy vJ^F and set V := D W. Note that V is not a compatible Dirac 
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operator. Therefore, we must define its 77-invariant by zeta function regularization. 
Thus, we define the 77-invariant 77 (P) as the value of the function 

s ^ / Tr Ve~*^ 

r(s + i) Jo 

at 5 = 0, where the integral converges for Re(s) 0 and has a meromorphic 
continuation which is regular at s = 0. In fact, we will see below (Proposition 6.4) 
that the integral converges locally uniformly for Re(5) > — ^ . 

For T > 0, we define the rescaled metric structure 

(T) * /2-\-np' /4 jFrpNp /2—rtF /4 

Let be the metric structure on 0(M, F) induced by J^{T) and and 

define V{T) using Then we have 

Vt := V{T) = p + 

Note that Vq = D is well-defined. Furthermore, we have t]{T>t) = rj{'D{T)). 
Below we show that t]{Vt) is independent of T G (0,oo). We obtain the proof of 
Theorem 4.17 by considering the limits T 0 and T — > co. 



Proposition 6.2. t]{Vt) is constant for T G (0, co). 



Proof. By Hodge theory the kernel of T>{T) for T G (0, 00) can be identified 
with the cohomology of the total complex F), -h u), i.e., with the hyper- 

cohomology HH{M, F). The kernel of T>t is isomorphic to the kernel of P(T) and 
thus has constant dimension. It follows that 77 (Pt) is a smooth function of T, and 
its derivative is given by the coefficient — ^ where b_i /2 is a coefficient of 

the asymptotic expansion 



Tr 



dVr 



e 



-m 



2 

T 



t^O 






We now show that we can apply [8, Lemma 2.11] which states that 6_i/2 = 0. 
Let D be the restriction of := J^d + dJ^ to where de- 

notes the metric structure on 0(M) induced by the Riemannian metric . 
By we denote the twist with F, or, what is the same, the restriction of D 
to F) (the superscript refers to the form degree). We have an isomor- 
phism : n°^^(M, F) = such that we can identify Q.{M^F) = 

F) 0 n®^(M, F). In this identification D and W correspond to 

0 \ / 0 

0 D^J’ 0 



Up to the sign, P has the form [8, (2.5)]. The role of that sign in the argument of 
[8, Lemma 2.11] is to assure that the anti-commutator of the Dirac operator and 
the potential is a zeroth-order operator. Since in our situation DW + WP is still 
of zero order, the argument of [8] applies. □ 
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Let hc '^1 •= Np,v) be as in Paragraph 4.4.2 associated with the 

hypercohomology spectral sequence. 

Proposition 6.3. ForT g (0,cx)) we have t]{Vt) - rji'^o) = hen. 

Proof. r]{VT)—r]{T>o) is the difference of the numbers of eigenvalues (counted 
with multiplicity) of T>t which become positive and negative when T moves from 
0 to positive values. 

The eigenvalues of Vt which tend to zero as T — > 0 can be described in terms 
of the hypercohomology spectral sequence {hcEr, hedr)^ We employ the method 
developed in [4, §VI]. In particular, we realize the spaces hcEr using Hodge theory 
to obtain natural metric structures induced by J^’^. 

Fix r > 1 and £ > 0 sufficiently small. We can find a > 0 such that ±aT^^‘^ 
is not in the spectrum of T>t for T G (0,e). Let := Ej^~r/ 2 x,^{—a,a) be the 
spectral projection, i.e., the orthogonal projection from fI(M, P) on the direct 
sum of the eigenspaces of associated to eigenvalues lying in (—a, a). 

Then as T 0 the spectrum of Vt P^t converges to the spectrum of 

hcDr '= (cL [4, (6.55)]). This implies (using Definition 4.7 

and Lemma 4.6 for the second equality) that 

T?(Dt) - ??(X>o) = y^sign(hcr>r) = hcTl- 

r>l 

□ 

Recall the definition of the families of forms ^(t) in Q(M) which enter the 
Definition 3.15 of Npj ,v). Recall also that L(V^^) is defined in Subsec- 
tion 4.2.2. 



Proposition 6.4. There is some AT g N such that 
Tr = 2y/^ f L(V™) A 

JM 

Proof. This follows from [8, (3.1)] and some local index theory calculation. 
In fact, our operator is (locally) the spin Dirac operator twisted with the tensor 
product of the spinor bundle and F. This explains the appearance of the L-form 
above and the matrix structure of D, W in the proof of Proposition 6.2. □ 
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Corollary 6.5. 

lim ^ / TV Vre-^^T -^=2 L{V™) A fj{T, Np, J^,v). 

T^oo Vtt Jo Jm 

Lemma 6.6. Given N e N, there are functions ai(z) bounded for z € [l,oo) 
and rN{t,T) bounded for T € [l,oo), t > T~^ such that 

N-l 

T-^/^TrVre-*'^^^ = ^ ai/2(Tt)f^^ + t^^^rN{t,T). 

i= — n 

Proof. This is essentially [ 16 , Thm. 1.7] (cf. [8, (4.81)]). In [ 16 ], the situation 
is more complicated, since it corresponds to an infinite-dimensional bundle F and 
unbounded differential v, namely a fibrewise de Rham complex. But the proof given 
in [ 16 , §3] can be applied in our situation with many simplifications. First we write 
T>t = _|_ \Y'j SQ parameters x and t in [ 16 ] correspond to 

and Tt in the present paper. 

The localization part [ 16 , §3.1] is just the usual finite propagation speed ar- 
gument. Now we construct the rough parametrix as in [ 16 , §3.2]. Then we verify 
that the proof of [ 16 , Lemma 3.4] goes through in our situation. Note that formula 
[ 16 , (3.5)] simplifies a lot in the present situation. The remaining argument using 
Duhamel’s principle can be taken without change. □ 



We employ the suggestive notation Voo and 

establish the estimate which corresponds to [ 16 , (1.14)]. 



Proposition 6.7. Given a G (0, 1), there exists constants C > 0, N E N such 
that, for T > 1, t > we have 



Tr 



Tr Pooe 



-tv 



2 

oo 



C 

— j^i/2 niin(l, t^) 



Proof. We decompose ^ F := Eq ^ Ei, where Eq := kerVF and 

El Eq. Let Q be the projection onto Eq and = l — Q. With respect to this 
decomposition we write 



/ Vt,1 Ft,2\ 
\Pt,3 ) 



T>t^i is independent of T and can be identified with Voq. We extend Pqo by zero 
to C^(M, El). 

Let cr{A) C C denote the spectrum of the operator A. Let 



[/t := {A € C I |A| < Ci\/f, inf |A-m|>C 2 }, 

fie<T(Voo) 



where Ci,C 2 > 0 are sufficiently small and will be fixed below. Following [ 11 , §9] 
we first show the following lemma: 
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Lemma 6.8. For p > dim(M) + 1, there exist constants C > 0, Ti > 1 such 
that, for T >Ti and X e Ut, 

(6.1) ||(A - Vt)-^ - (A - Poo)-"Q||i < ^ (1 + 1^1)^ 
where ||.||i denotes the norm on trace class operators. 

Proof. In some sense, this is a special case of [11, §9]. Instead of writing all 
details we explain how the the arguments given in [11] can be employed in the 
present case. 

The operator Vt,i = QDQ is as in [11, §9 (b)], but much simpler. Further- 
more, Vt ,2 = -Q[D,Q] e C^{M,Rom{E^,Eo)), Pt ,3 = QHD,Q] e C^{M, 
E.om{Eo, Eq)) are independent of T and bounded. Therefore, we have a stronger 
version of the estimate [11, (9.38)]. 

If (/) G C^{M,Ei), then using elliptic regularity, the fact that DW FWD is 
bounded, and that is injective, we obtain the estimate [11, (9.48)]: 

(6.2) ||pT0f = 

= ((^, (^D‘^ + T^I^{DW + WD) -h TW‘^^ (j)) 

= \\D(t)f -h {DW -h WD)(j)) -h T||IF<^f 

— ^l(ll^llvVi(M,E) E {T — d2)||0|p), 

where d\,d 2 > 0 are independent of T > 1 and </>, ||.|| denotes the L^-norm, 
and W^{M,Ei) is the L^-based Sobolev space of order one. We now conclude 
[11, (9.104)]: There are constants Tg > 1 and dg > 0 such that, for T > Tg, 
cf>eC^{M,E^), 

(6-3) |pT,40|| > d^{\\(l>\\w^{M,Er) + ^ll^ll)- 

Thus there exists a constant C\ such that, for T > Tg, |A| < ^\/T, we have [11, 
(9.106)], 

||(A-2?r,4)-V||<;^IHI, 

||(A - Dta) V||wi(m,Ei) < Cl ||(/)||, 

for all (j) G C^{M,Ei). The following estimates are proved exactly as in [11, 
Prop. 9.18]. For p > dim(M) + 1, there is a constant C 2 > 0 such that, for T >Tq, 
|A| < f x/T, 

1I(A-Pt,4)-'||oo<^, 

||(A-Pt,4)-'|Ip<C2, 

IPt,2(A - I>t,4)“^||oo < 
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where ||.||p denotes the norm of the pth Schatten class. 

We now fix C 2 such that a (Poo) H (— 2 c 2 , 2 c 2 ) C {0}. Furthermore, we assume 
that at least 2 ci < d^. Following [11, (9.120)], for X e Ut and T > To, we define 

Mt{X) := X — Pt,i ~ Pt, 2 (^ ~ Pt,4) ^Pt,3- 

We have the estimates which correspond to [ 11 , (9.124)]: If ci is sufficiently small, 
then there are constants C 3 > 0 , Ti > Tq such that, for T > Ti, A G Tr, we have 

||Mt(A)~^||oo < C's, 

||Pt,3^t(A) ^IIoo ^ Cs, 

\\MT{Xr%<Cs{l + \X\), 

||Mr(A)-P - (A - < ^(1 + |A|)p. 

Note that in our case the operator defined in [ 11 , (9.125)] is trivial, and this gives 
the better power p instead of p + 1 in the last estimate above. Now we follow the 
proof of [ 11 , Thm. 9.23] to finish the proof of (6.1). □ 

Let ^ C C be the circle of radius C 2 centered at the origin and oriented counter- 
clockwise. For T > Ti, we have cf{Vt) Pi ^ = 0. Let Pt and Poo be the spectral 
projections of Vt and Poo corresponding to the interval (-^02/2, C2I2). Recall that 
Q is the projection onto Eq. Then, for T > Ti, we have 

Pt - PooQ = ^ ((^ - - T^oor’^Q) 

We conclude from ( 6 . 1 ) that \\Pt — PooQlli < C 4 /VT for some C 4 independent of 
T. Since T>tPooQ = 6 and Poo Poo — 0? there exists a constant C 5 such that, for 
T>Ti, 

(6.4) \\VtPt - P^PooWi < \\PtVt{Pt ~ PooQ)\\i < ^ ■ 

We conclude that there is a constant Cq such that, for T > Ti, 

(6.5) |IV PTPre-‘®- - Tr \ < 

Let A be the oriented path in C which goes parallel to the real axis from 
—00 — ic 2 to C 2 — ic 2 , then parallel to the imaginary axis to C 2 + ic 2 , and then 
parallel to the real axis to — 00 + ic 2 , and which goes parallel to the real axis from 
oo + ic 2 to C 2 + ic 2 , then parallel to the imaginary axis to C 2 — ic 2 , and then parallel 
to the real axis to 00 — ic 2 . 

Let hp{X) be holomorphic on C \ iR such that ^^(A) = {p — 1)5 Ae"”^ . So 
up to a constant it is the function /p_i as defined in [ 11 , (9.165)]. In particular, 
we have the estimate [ 11 , (9.169)], 

|/*p(A)| <C 7 e-“^lY, AeA, 
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where C 4 > 0 and C 7 are independent of A. We have 
(1 - Pt) - (1 - Poo) Pooe-‘®“ 

= ^ ^ Ae-‘^' ((A - Pr)-' - (A - V^)-^Q) dX 

= i L "■ 

We split the integral into the parts ^i{T) :=An{A€ Ut} = An{|A| < ciVT} 
and A 2 (T) := A O {|A| > cix/T}. Let p := dim(M) + 1 . By Lemma 6 . 8 , there are 
constants Cs, Cg such that, for T>Ti,t>Q, 



( 6 . 6 ) 



\u. 



tiP+l)/2 



((X - Vt)-” - (X - Voor^Q) dX 



< 



Cs 



Tl/2f(p+l)/2 



[ e-^^‘l^l'(l + |A|)P(iA< 

7ai(T) 



Cg 



j’l/2jp+l ■ 



It follows from (6.2) that there is a constant Cio such that, for all P > Pi, A G 

A2(P), 

|1(A - Pt)-"||i < Cio, ||(A - Pco)“'’Qlli < Cio. 

We obtain constants Cu, C 12 , C 13 such that, for all T >T\ and t > 



li/. 



hp(p/^A) 



A.(D 

Cii 



((A-Pt)“'’-(A-Poo)~'’Q) <^A 



< 



f(P+l)/2 



L 



-C4t|A"|^A < 



^12 _^-CtTt/2 ^ 



Cl3 



A2(T) 



t(P+2)/2 



Cu 



We combine ( 6 . 6 ) and (6.7) to obtain 

(6.8) ||0-PrfI,,e-»J-(l-P„)P„e-»Hl.i 

for T > Ti and t > where C 14 is independent of T, t. Together with (6.5) 

this implies the assertion of the proposition. □ 



The estimates in Proposition 6.4, Lemma 6 . 6 , and Proposition 6.7 are all 
the ingredients which are necessary to perform the proof of [ 16 , Prop. 1.8]. We 
conclude 



Corollary 6.9. For P > 0 sufficiently small, we have 



lim [ TrpTe^*®^ = 0 . 

T^ooJt^-1+c fl /2 



Fix I — a > P > 0 such that Corollary 6.9 holds. Note that Tr T>ooe~^^^ — 
0(1) as t ^ 0 (cf. [ 9 , Thm. 2.4]). The following is an immediate consequence of 
Proposition 6.7: 
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Corollary 6.10. 



lim 






TrV^ 






dt 



It follows from (6.8) that ||(1 — Pt)T>t^ ^^lli is uniformly bounded for T > 
1. Since PtVt > C 2 for all T > Ti, we have a constant C such that j|(l — 
Pt^) 11^ < Ce “*^2 for all T > Ti, t > 1. We conclude that there is a 
constant Ci such that, for all T >T\, 

Using (6.8) and Lebesgue’s theorem about majorized convergence, we obtain 



Corollary 6.11. 

t'“ r TKI - 

Note that Pt and Poo are finite-dimensional projections. Since VooPoo = 0 it 
follows from (6.4) that the spectrum of PtPt converges to zero as T oo. We 
have 



lim ^ 

T-^oo a/tT 



L r 

Rh 



Tr PrI?Te“‘®^ 



dt 



lim 

T — >-CXD 



T -T 



/ie 



— tfj . 



■ lim 

T — >oo 



fxGcr{T>T Pt) 



n£a{T>TPT) 

dt 

^ 1/2 j'^oo 



dt 



1 POO 

V'O- D_\ V j 



Ii£(t{T>tPt) 



Let igT 2 igT 2 {P,q, N,v) be associated to the local-global spectral sequence 
as in Definition 4.8. 



Proposition 6.12. We have 

lim V sign(M) = igT 2 . 

1 — >oo 

IJ-€icr{T>'r Pt) 

Proof. The eigenvalues of Vt which tend to zero asT oo can be described 
in terms of the local-global spectral sequence (igEr, igdr). We apply the method 
of [ 4 , §VI] to Vt = T^I'^W + D. In particular, we realize the spaces igEr using 
Hodge theory to obtain natural metric structures (induced by J^’^). 

Fix r > 2. We can find a > 0, Ti >1 such that is not in 

the spectrum of Vt for T > T\. Let P“^ := Ej^(r-i)/ 2 T>^{—a,a) be the spectral 
projection. Then as T — » 0 the spectrum of T^’^~^^!^VtP^t converges to the 
spectrum of igDr This implies 

T^ E sign(/i) =^sign(,gP,.) = jgT 2 

jj,^a{'DT Pt) r>2 

and hence the proposition. □ 
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Combining Propositions 6.2, 6.3, 6.5, 6.9, 6.10, 6.11, and 6.12 we finish the 
proof of Theorem 4.17. □ 

6.3. Proof of Theorem 5.9. We consider a family of superconnections de- 
pending on two parameters (T, u) G (0, cx)) x (0, oo). The parameter u is the usual 
rescaling parameter associated to the total grading of Q{Z^F). The parameter T 
is associated to the form degree. If T becomes large, then the de Rham differ- 
ential is scaled large compared to the differential v of the complex. To stay in 
our formalism we are going to work over the base B := (0, cxd) x (0, oo) x B. Let 
pr: ^ .B denote the projection and define tt: M := pr*M B with fiber Z. 
Let pr^ : M M be the projection. Let TZ he the relative tangent bundle of tt, 
i.e., TZ — pr^TZ. This bundle is equipped with the vertical metric on TZ 
which restricts to {Tu)~^g^^ on the fibre over (T, n) x {b} G B. We define the 
metric structure on pr^F such that it restricts to ^^-^F+nF /2 jF^iVir-nF /2 
over (T, u) x M. The metric g^^ and together induce the metric structure 
jz,F Q,(Z,pr*j^F) (cf. (5.1)). Let be the twisted de Rham differential on 

fI(M, pr)^F). We define d = consider the form p(d, J'^’^) on 

B defined in (5.2) if n is even (resp. in (5.7) if n is odd). 

Definition 6.13. We define (3 := du /\ (3'^ dT /\ (3^ to be the part of 
p(d, J^’^) G D(B) of degree one with respect to the coordinates (T, u), with 
functions (3'^^(3^ \ ( 0 , oo) x ( 0 , oo) ^ D(B). 

The following corollary is an immediate consequence of the fact that p(d, J^'^) 
is closed. Let d = dr,u + be the decomposition of the de Rham differential on 
(0, oo) X (0, oo) X B. 

Corollary 6.14. There exists a smooth family a: (0, oo) x (0, oo) Q{B) 
such that 

(6.9) dr^uP = dT Adu d^a. 

The following theorems can be shown by adapting the methods of the cor- 
responding references to our present situation. Actually, the following results are 
analogues of some related properties of Bismut-Lott’s real analytic torsion forms, 
see especially [24, Thms. 4. 3-4.9], where we work in a much more complicated 
situation (instead of the finite-dimensional fiat vector bundle here we have an 
infinite-dimensional vector bundle there). See also Subsection 6.5 for more details. 

Let B := (0, oo) x B. Let Nh{z,f) be the Z-grading on H{Z^F) induced 
by Nf- We consider the metric structure on H{Z^F) := pr*B(Z, F) 

which restricts to Qy0j. x B. We 

consider the flat (-l)^^(^’^) -superconnection B' := +Vh{z,t)i where the 

differential vu(^z,t) dI{Z^F) is induced by v. 

Let be the form on B defined in Subsection 3.4.4 if n is 

even (resp. in (5.10) if n is odd). Let 7 : (0,oo) ^ Q.{B) be such that 
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where the remainder r does not contain du. 



Theorem 6.15. (1) For any n > 0, 

(6.10) lim /3^{T,u) = 

T — ^■oo 

(2) For 0 < ui < U 2 fixed, there exists C > 0 such that, for u e [ui,U 2 ], T > 1, 
we have 

( 6 . 11 ) \p-{T,u)\<C. 

(3) We have the following identity: 

rOG roo 

(6.12) lim / p'^{T,u)du=^ / 'y{u)du ^ hcdr) ^ 

Jl 



Theorem 6.16. (1) There exists a smooth family a : (0,oo) 
for T > I, we have 



lim /3^{T,u) — (j{T). 



fl{B) such that. 



(2) There exist constants C > 0, S > 0 such that, for T >1, we have the following 
estimate: 



( 6 , 13 ) 



(■'(I-)! ^ jS*- 



(3) Modulo exact forms on B we have the following identity: 

/ oo 

a(T)dT = ~f,{nH,hcGx{HH),J^^ 

Note that (6.14) follows from Lemma 3.17 as in the proof of [ 24 , Thm. 4.5]. 
Let M = (0, oo) X M, Pr : M M be the canonical projection. We consider the 
vertical metric g^^ on M for the fibration M B which restricts to u~^Fv*g^^ 
on the fibre over (u,b) G (0, oo) x B. induce a metric structure 

on Pr* fl{Z,F) on B. We define the smooth family 0 : (0, oo) ft{B) such that 
(cf. Subsection 5.2.2) 

J^’^) =duA9 + r 

and r does not contain du. Note that by Definitions 5.3 and 5.4 

poo 

/ 6{u)du= -fi{niZ,F),Nz,J^'^,d^). 

Jo 



Theorem 6.17. (1) For any u > 0, there exist C > 0,6 > 0 such that, for 
T>1, 

(6.15) \/ 3 ^( T , u )\<^. 

(2) For any T > 0, we have 

(6.16) \ ime ~^ P ^{ T£~^,s)— 6 {T). 
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(3) There exists C > 0 such that, for e G (0, 1], 6 < T < 

(6.17) e-^\l3'^{Te-\e)\<C. 

(4) There exist G (0, 1], (7 > 0 such that, for e e (0, 1], T > I, 

(6-18) 

Proof of Theorem 5.9. We now finish the proof of Theorem 5.9. For 0 < 
£< A and 1 < Tq, we consider the rectangle (T,u) G R := [1,Tq] x [£,A], By 
Corollary 6.14 we have P = a. Thus 

f P^{To,u)du- J " p'^{T,A)dT- J p^{l,u)du + J ° p'^{T,e)dT 

= 7l + /2 + ^3 + ^4 

is an exact form on B. We take the limits ^ ^ oo, Tq ^ oo, and then e ^ 0 in the 
indicated order ([4, §4 (c)], [22, §4 (c)]). Let Ij, j = 1, ... 4, A: = 1, 2, 3 denote the 
value of the part Ij after the kth limit. Note that by [28, §22, Thm. 17], if ak is 
a family of smooth exact forms on B which converges uniformly on any compact 
set K C B to a, smooth form a, then a is exact. Thus modulo exact forms on B, 
= 0. We obtain by the definition of fj{Q{Z, F),q, d) that 

Furthermore, by Theorem 6.16 and in particular (6.14) we get 
7| = 7| = f}{nH, hcGrinH), 

Now 7(u) = 0(1) as u ^ 0, and by Definition 3.15, (5.10), 

poo 

/ 7(«)du = -ii{hc£i, KcEi, hcdi) ■ 

Jo 

From (6.10), (6.11), and (6.12) we conclude that 

-^1 = -y^.vjhc^r, ^ hcdr) ■ 

r>l 



Finally, using Theorem 6.17, we get 

lf = -ri{'[l{Z,F),Nz,J^'^,d^). 

These four equations imply Theorem 5.9. □ 
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6.4. Proof of Theorem 5.10. We consider again two parameters (T, it). 
Here u is the rescaling parameter corresponding to the total grading of F) 
and T is associated to the grading of F. For large T, the rescaled differential v 
becomes large in comparison with the de Rham differential. 

Let B := (0, oo) x (0, oo) x B. Let pr : B B denote the projection and define 
M := pr*M — > B with fiber Z. This bundle is equipped with the vertical metric 
onTZ which restricts to on the fibre over (T, u) x {b} G B. We define 

the metric structure such that it restricts to 

over (T, u)x M. The metric g^^ and together induce the metric structure 
on Q.{Z,prlfF) (cf. (5.1)). 

As in Section 6.3, let d = be the pull-back of d. Let p(d, J^’^) 

be the form on B defined in (5.2) if n is even (resp. in (5.7) if n is odd). 

Definition 6.18. We define j3 = duf\f5^ FdT f\pF to be the part ofp(d, J^’^) 
of degree one with respect to the coordinates (T, u), with functions : (0, oo) x 

(o,oo) ^ a(B). 

The following corollary is an immediate consequence of the fact that p(d, 
is closed. 

Corollary 6.19. There exists a smooth family a: (0, oo) x (0, oo) ^ Q{B) 
such that 

(6.19) dr^uP — dT A du d^a. 

Let B (0, oo) x B and pr ^ : B ^ B be the projection. We consider the bun- 
dle M pr^M B with fiber Z. Let Pr: M M be the induced map and H = 
FFH be the pull-back of the fiat cohomology bundle H of (F, v) on M. We consider 
the metric structure on H which restricts to 

over {u} X M. Furthermore, we consider the vertical metric g^^ on TZ which 
restricts to u~^Fv* g^^ on the fibre over (u, h) G B. They induce the metric struc- 
ture on pr* Q{Z,H) as in (5.1). Let be the Z-grading on H induced by 
Np. The total Z-grading on fl(Z, H) is Nz^h — + Nh- Let d^ be the twisted 

de Rham differential on 0(M,JT). Then d^ is a flat (—1)^^-^ -superconnection 
on pr* {Q{Z,H))] here Nz,h — We define the family 7 : (0,oo) — ^ Ft{B) 

such that 

p{d^ , J^’^) = difc A 7 -f r, 

where r does not contain du. By Definitions 5.3 and 5.4, 

pOO 

(6.20) / y{u)du = 

Jo 

Theorem 6.20. (1) For any w > 0, we have 

(6.21) lim /?“(T,«)=7 (w). 

1 — >oo 
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(2) For 0 < ui < U 2 fixed, there exists C > 0 such that, for u ^ [ui,U 2 ], T > 1, 

(6.22) \p-{T,u)\<C. 

(3) We have the following identity: 

poo poo 

(6.23) lim / /3^(T,u)du= / ^(u) du , igdr)- 

Ji ,>2 



Theorem 6.21. (1) There exists a smooth family a : (0,oo) 
for T > 1, we have 



lim 0^{T,u)=a{T). 



Ct{B) such that. 



(2) There exist constants C > 0, 6 > 0 such that, for T > 1, we have the following 
estimate: 



(6.24) 



W{T)\ < 



C 

J'l+S • 



(3) We have the following equality modulo exact forms on B: 

/ OO 

a{T) dT - - f}[HH,igGr{nH), 



We consider the metric structure on Pr*F which restricts to y^-^F+riF/ 2 jF 
uNF-riF /2 1^1 ^ consider + u as (—1)^^ -superconnect ion on F. 

We define the smooth family 6: (0,cxd) — ^ ^1{M) such that 

p(Pr*(V^ + v), J^) = du A6 F r, 

where r does not contain du. Note that by Definition 3.15 

poo 

/ 9{u)du = ~fj{fF,NF,J^ ,v). 

Jo 



Theorem 6.22. (1) For any u > 0, there exist (7 > 0^ > 0 such that, for 

T > 1, we have 

(6-26) \(3T^t,u)\<^. 

(2) For any T > 0, we have 

(6.27) lim 13^^ (Ts~\ e) = f L(V'^^) a6{T). 

^-^0 Jz 

(3) There exists C > 0 such that, for e G (0, 1], e < T < 1, we have 

(6.28) £-1 |/?^(T£-\£)| < C. 

(4) There exist 5 G (0, 1], C > 0 such that, for e G (0, 1], T > 1, we have 

(6-29) e-^\f3^{Ts-\e)\<^. 
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Proof of Theorem 5.10. We now finish the proof of Theorem 5.10. For 
0 < £ < ^ and 1 < To, we consider the rectangle (T, ti) G T := [1, Tq] x [s, A], By 
Corollary 6.19 we have (3 = Jj^a. Thus 

J P'^{To,u)du- J ° p'^{T,A)dT - J P'^{l,u)du + J ° P'^{T,e)dT 

= Ii 12 3 - h + h 

is an exact form. We take the limits A 00 , Tq — > 00 , and then £ — ^ 0 in the 
indicated order. Let 7^^, j = 1, ... 4, A: = 1, 2, 3 denote the value of the part Ij after 
the A;th limit. Then modulo exact forms on B, 7| = 0. We obtain by the 

definition of f](Q{Z, F),Nz,f, that 

ll = fi{n{Z,F),Nz,F,F’^,d). 

Furthermore, by Theorem 6.21 and in particular (6.25) we get 
7| = 7| = 77 ( 7777 , 7,cGr(77T7), , jncCdHH)y 

From (6.20), (6.21), (6.22), and (6.23), we conclude that 

7f = -fl{n{Z,H),Nz,J^’^,d^)-Y,fl{lg£r,N,^B^,J‘^^\lgdr). 

r>2 



Finally, using Theorem 6.22, we get 

l! = -J L{V^^)Aij{F,NF,J^,v). 

These four equations imply the theorem. □ 



6.5. Proof of Theorem 5.11. By the variation formula for eta forms (The- 
orem 5.6) it suffices to prove Theorem 5.11 for a particular choice of T/^W, T^V, 
T^W, and , 9^ ^ ■> 9^ ■ We will suppose that 

(6.30) T^W C T^W, 



We consider a family of superconnections depending on two parameters (T, u) 
G (0, 00 ) X (0, 00 ). The parameter u is the usual rescaling parameter associated to 
the total grading of 17(Z, F). In the present case the fibre Z is the total space of 
a fibre bundle Z ^ Y with fibre X, The parameter T is introduced to perform 
an adiabatic limit in this fibration. For large T the vertical part corresponding to 
of the differential d^ is scaled to become large with respect to the horizontal 

part. 

Let us now fit this idea into the formalism. We consider the space *§ := (0, 00 ) x 
(0, 00 ) X S. Let pv: S ^ S denote the projection and define W := pr*IT ^ 5 
with fiber Z. Let pr ^ : W ^ IT be the canonical projection. We consider the 
decomposition of the vertical bundle TZ = TX^T^ Z ^ where Z Tf^WnTZ . 
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Then Z = irlTY. We define the metric g^^on Z = prJ^(TX 0 ttITY) such 
that it restricts to 0 over (T, u) x S. The metric g^^ and 

together induce the metric structure on pr*0(Z, F) as in (5.1). 

Let be the twisted de Rham differential on n(W,prJ^F). Further let 

p(dP^^^, J^’^) be the form on S defined by (5.2) if n is even (resp. by (5.7) if n 
is odd). 

Definition 6.23. We define (3 — du A (3'^ dT A /3'^ to be the part of 
of degree one with respect to the coordinates (T,u), with func- 
tions (0, oo) X (0,oo) — > Q{S). 

The following fact is an immediate consequence of the fact that p(d, J^’^) is 
closed. Let d = dr,u + be the decomposition of the de Rham differential on 
(0, oo) X (0, oo) X S. 

Corollary 6.24. There exists a smooth family a: (0,oo) x (0,oo) ^ ff(5) 
such that 



(6.31) dr^uf3 = dT Adu d^a. 

To compare easily to [ 24 , §4-§9], in the following we will write down explicitly 
. For ai, 0^2 two differential forms on 5, we denote {ai + dua2}^^ = «2, 
and {ai + dT a 2 }^^ = Q!2. 

Let *r be the metric structure and the Hodge star operator on 0(Z, F) 

with respect to the metrics T~‘^g^^ and (cf. Subsection 4.3.1). Then 

we have 4'^ = 2^-Nx+dimX/2 jZ,F^Ax - dim X/2 ^ 

Let V^’^, ir be the operators defined in Subsection 5.2.2. Let (d^)^, (d^’^)^, 
(^t)t? (V'^’^)J. be the formal adjoints of d^, d^’^, zt, respectively, with 

respect to the metric structure 4'^ Q(Z,F). Then 

1 1 

(6.32) *-i^ = _(27Vx-dimX), 



For u > 0, we set 



— 2^C^3, u^,T + C'3 u2 J’), 



a 



Iff 

3,^2^ 



^ n,-Nz f^F\* Nz 



(d )^u 



— x(^3U^,T ^3,u2,t)- 



We denote by [A,B] = AB — BA the commutator. For T > 1, set Au^t = 
. Then from the above equations we get 
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• If n is even, then 

(6.33) 13'^ = (27ri)“^/VTr[2:'^'r’'"(Ac3^^2_x)exp(-C|_„2,x)]> 

^ 7 ^^] exp(-C|,„ 2 ,^)] . 

Thus we get 

(6.34) /3“ = (27Ti)“^/^(p ■! exp(-v4^ j. + dw(— 24„,r))j > , 

0^ = (27ri)“^/^<p exp(-24^ + dT {-^Au,t))\ | • 

• If n is odd, we introduce an extra odd variable <t as in Subsection 5.2.2. 
Then 

(6.35) /?” = exp(-C'|_„ 2 _r)] , 

0 '^ = ;^<pTra[2'^^'"[^-D3,u2,T,*7^^]exp(-C^^„2_r)]. 

Remark that commute with (V^’^ + (V'^’^)^, + ir + l^T)^- Let 

T Le ^Le part of .A^i,T of degree z in A{T*S), Then + (V^’^)^). 

Set Au^t - + 4'^). Then 

1 r 'I 

(6.36) [exp(-^lT + I - 

|Tr<^ [exp(-v4^ + dT(— A,r))] | • 

The following theorems can be shown by adapting the the method [24] to our 
present situation. 

Let S :— (0,oo) x S and pr^ : ,§ ^ S' be the projection. We consider the 
bundle V := pr*V S. Let pr^: T ^ F be the induced map and if(X, JF) = 
pryiL(X, .F) be the pull-back of the flat cohomology bundle H{X, T) of (Q(X, F), 
d^’^). We consider the metric structure which restricts to 

over {u} X V, Furthermore, we consider the vertical metric which restricts to 
^pry^^^ on {u} X V. They induce the metric structure on pr* n(T, 

H[X^T)) as in (5.1). Let be the twisted de Rham differential on fl(F, 

pryid(X, F)). Note that the Z-grading operators Nz, Nx, Ny act naturally 
on ^1{Y,H{X,X)). Then ig ^ flat (- 1 )^^ -superconnection on pr* n(T, 

H{X^T)). We define the family 7 : ( 0 ,oo) ^ fl(S) such that 
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where r does not contain du. Note that = 0 if dimX is odd. 

Furthermore, note that by Definitions 5.3 and 5.4 

nOO 

(6.37) J 'r(u)du = -ri{hc£i,N^^E^,J'‘°^\hcdi) 

= -fi{n{Y, H{X,T)), Ny, 

Theorem 6.25. (1) For any u > 0, we have 

(6.38) lim /3“(T,w) = 7 (m). 

T — >oo 

(2) For 0 < u\ < U 2 fixed, there exists C > 0 such that, for u G [ui,U 2 ], T > 1, 
we have 

(6.39) \p^{T,u)\<C. 

(3) We have the following identity: 

rOO nOO 

(6.40) lim / l3^{T,u)du= y{u)du - 

Ji ^ 

Theorem 6.26. (1) There exists a smooth family a : (0, oo) — > fl{S) such that, 
for T > 1, we have 

lim 0^{T,u) =a{T). 

u-^oo 

(2) There exist constants C > 0, S > 0 such that, for T > 1, we have the following 
estimate: 

(6.41) k(T)| < ^ 

(3) We have the following identity: 

/ oo 

a{T) dT = -f,{n(Z,T), LsGr{H{Z,F)), jH(z,:f) ^ j,.sGr(H(z,:F))y 

We consider the fibration W = (0,oo) xW V equipped with the vertical 
metric g^^ which restricts to u~^g^^ on {u} x W. Let Pr^ : W W he the 
projection. PrJ^J^ and g^^ induce a metric structure on pr^D(X, F) as in 
(5.1). Let d^^^^ be the twisted de Rham differential on n(W,PrJ^F). We define 
the smooth family 9: (0, oo) il{V) such that 

J^’^) =duA6> + r, 

where r does not contain du. Note that by Definitions 5.3 and 5.4 

pOO 

/ e{u)du= -ij{n{X,F),Nx,J^’^,d^). 

Jo 

The adiabatic family of metrics g^^ 0 ^ Tvlg^^ on Pr^TZ on W induces a 
family of connections of PrJ^TZ which after restriction to {T} x W is the 
connection on TZ with respect to g^^ , T^W , tts defined by [5, Def. 1.6]. 
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By [24, Thm. 5.1], for large T, converges to + ^ 3 , 00 , where ^ 3,00 ^ 

(g)End(r^Z, TX). We define the smooth family A: (0, 00 ) Q{W) such that 

L(V^^) -dTAA + r 

and r does not contain dT. Now, by the same argument as in [24, § 5.7], we have 
the following proposition for the transgression L claiss. 



Proposition 6.27. When T 
exact forms on W we have 



00 , then we have A(T) = 0(T ^). Modulo 



(6.43) 



/ CXD 

A(T) dT. 



Theorem 6.28. (1) For any u > 0, there exist C > 0, (^ > 0 such that, for 
T > 1, we have 

(6.44) \P^{T,u)\ < 

(2) For any T > 0, we have 

( 6 . 45 ) liiri£-V^(T£“S£) = [ L(V^^) a6»(T). 

£^o Jy 

(3) There exists C > 0 such that, for £ S (0, 1], £ < T <1, 

(6.46) £-1 |/?^(T£-i,£)-y p(V^, J^) AA(T£-1)| < C. 

(4) There exist J G (0, 1], (7 > 0 such that, for £ e (0, 1], T > 1, 

(6.47) £“^ \p'^{Te-\e)\ < AA, 

Proof of Theorem 5.11. We now finish the proof of Theorem 5.11. For 
0 < c < ^ and 1 < To, we consider the rectangle (T,u) e R := [I, To] x [£,A]. By 
Corollary 6.24 we have ^ — d^ f^a. Thus 



[ p^{To,u)du- [ "" P^{T,A)dT- [ f3^{l,u)du+ [ " f3^{T,£)dT 

J £ J 1 J £ J 1 

= h A h F h h 

is an exact form. We take the limits A oo, Tq ^ oo, and then ^ ^ 0 in the 
indicated order. Let Ij, j = 1, ... 4, k = 1, 2, 3 again denote the value of the part 
Ij after the kth limit. By [28, §22, Thm. 17], dQ{S) is closed under uniformly 
convergence on compact sets of S. Thus modulo exact forms on 5, = 0- 

We obtain from the definition of r)(0(Z, F),Nz, d^) that 

ll = ri{n{Z,F),Nz,J^’^,d^). 

Furthermore, by Theorem 6.26 and in particular (6.42) we get 

II r= ll = *cGr(?ii7), J"", 



To 
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From (6.37), (6.38), (6.39), and (6.40), we conclude that 

~ ^igEr^ ^jlgdr)' 



r>2 



Finally, using Theorem 6.28, we get 

7| = - ^ L(V^^) A v{n{X, F), Nx,J^’‘", d^') 

- [ L(TZ,V^^,°V^^) Aj9(V^, J^) 
Jz 

as follows: Convergence of the integrals below is granted by (6.44). We write 

/ oo ^oo 

0^{T,t)dT = £-^f3'^{Te-\e)dT. 

Using Proposition 6.27, (6.45), and (6.47), we get 

/ OO n ^OC 

e~^l3'^{Te-\e)dT = J L(V^^) A J 6{T)dT, 



dT = 



lim [ e“d/?^(T€-\e) - [ p{V^ , J^) A \{Te-^) 

I Jz 

[ L(V'^'^)A [ 9(T)dT. 
Jy Jo 

The remaining part of the integral yields by (6.43) 
lim^ j p{V^,Y) A\{Te-^)dT = J p(V^,J^)A^ X{T)dT 

= - j L{TZ, °V^^) A p(V^, E). 
These four equations for 7|, k = 1, ... ,4, imply Theorem 5.11. □ 
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Toeplitz operators, and ellipticity of boundary value 
problems with global projection conditions 

B.-W. Schulze 



Abstract. Ellipticity of (pseudo-)diflFerential operators A on a compact man- 
ifold X with boundary (or with edge) Y is connected with boundary (or edge) 
conditions of trace and potential type, formulated in terms of global projec- 
tions on Y together with an additional symbolic structure. This gives rise 
to operator block matrices A with A in the upper left corner. We study an 
algebra of such operators, where ellipticity is equivalent to the Fredholm prop- 
erty in suitable scales of spaces: Sobolev spaces on X plus closed subspaces of 
Sobolev spaces on Y which are the range of corresponding pseudo-differential 
projections. Moreover, we express paramet rices of elliptic elements within our 
algebra and discuss spectral boundary value problems for differential opera- 
tors. 



Introduction 

Ellipticity of differential (and pseudo-differential) operators on a manifold X 
with boundary Y = dX is connected with a specific control of data near the 
boundary. More generally, ellipticity on a manifold with edges or with higher (say, 
polyhedral) singularities includes conditions on the lower-dimensional strata (e.g., 
edges, corners, etc.) of the configuration. 

Such conditions may occur as trace or potential operators, linked to the sin- 
gularities. 

It is a common point of view to interpret A together with the trace and 
potential conditions as an operator block matrix A (with A as upper left corner) 
and to construct an algebra of such block matrices that contains the parametrices 
of elliptic elements, see Vishik and Eskin [52], Eskin [12], Boutet de Monvel [7], 
Rempel and Schulze [31], [32], or Schulze [39]. In many known cases this is a 
transparent and satisfying concept. The operators A then have a principal symbolic 
hierarchy cr(^), and in simplest cases, ellipticity is invertibility of all components 
of a (A), where parametrices belong to a~^{A). 
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To illustrate phenomena we first consider the Ccise of boundary value problems 
for elliptic differential operators A on a compact manifold X with boundary 
Y with Shapiro-Lopatinskij elliptic conditions (also called SL-ellipticity in this 
paper) . 

By a boundary value problem in standard form we understand an equation 
Au — /, together with boundary conditions Tu = where A : C°^{X,E) 
C^{X, F) for E,F e Vect(X), is a given differential operator of order g and T = 
^(Ti, . . . , Tv) a column vector of trace operators Tj : C°^{X, E) Gj), for 

Gj G Vect(y), j — 1, . . . , Here Vect(-) denotes the set of all smooth complex 
vector bundles on the space in the brackets. The operators Tj are assumed to 
be given in the form Tj = ^'Bj, where r' is the operator of restriction to the 
boundary, and Bj : C^{X,E) C^{X^Gj) are differential operators of order 
/ij, with Gj G Vect(X), Gj Gj\y, j — 1, . . . , A/'. The" column matrix operator 

C^{X,F) 

0 

then extends to continuous operators 

(0.2) A:H‘‘{X,E)^ © 

between the respective Sobolev spaces of distributional sections for all real s > 
max(/i^ + §)• The principal symbolic hierarchy in this case consists of two compo- 
nents, namely 

(0.3) a{A) = {a^{A),cTdiA)), 

where cr^{A) := cr^{A) is the standard homogeneous principal symbol of A of 
order /x, also called the principal interior symbol, which is a bundle morphism 

(0.4) a^{A) : ^ 

TTx • T*X \ 0 — » X, and <jq{A) is the principal boundary symbol of A. To give a 
definition of the principal boundary symbol we first look at A. Let us fix a collar 
neighbourhood = T x [0, 1) of the boundary in the local splitting of variables x = 
{y,t) G 0 X [0, 1), C open, with covariables ^ = (^,'t). (For convenience, 

transition diffeomorphisms near the boundary are assumed to be independent of 
t.) We then have a family of continuous operators 

(0.5) ae{A){y, r?) ;= <T^{A){y, 0, r], Dt) : C* ® H%R+) ^ C' ® 

for {y^T]) G T*0 \ 0, acting in Sobolev spaces H^{Ry) := iL^(M)|K^ in normal 
direction to the boundary; k and I are the fibre dimensions of E and F, respectively. 
Using the invariance of (0.5) under transition maps we obtain a bundle morphism 

(0.6) ad{A) : tt^E' 0 iL"(R+) -> 0 F"(R+), 



( 0 . 1 ) 



A:= 



: G°°(X, E) 
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7Ty ' T*Y \0 0, where prime indicates the restriction of the corresponding 

bundle to the boundary. In a similar manner we can proceed for the trace operators 
Tj — r'Bj and obtain 

MTj){y,v) 

for (y,rj) G T*0 \ 0, where Ij is the fibre dimension of Gj. Globally, we have again 
bundle morphisms 

(TdiTj) : Ti^yE' ® 

j = 1, . . . , iV, and we set altogether 



(0.7) 



aa(A) 



■ Va{T)J- 



'■.E' ® 




for caiT) := ‘(aa(Ti), . . . , aa(Tjv)) and G := Gj. 

A boundary value problem A is called SL-elliptic, if (0.4) is an isomorphism, 
and if also (0.7) is an isomorphism for any sufficiently large real s. If we talk about 
the operator A alone, the first condition will also be referred to as <j^-ellipticity 
of A. 

The choice of s is unessential for the condition of SL-ellipticity. Moreover, (0.7) 
is an isomorphism if and only if 

/F'^S{W+)\ 

(0.8) (^d{A) : TTpE' 0 <5(E+) ^ ( 0 j 



is an isomorphism, <S(R_f-) := «S(R)|^^. Simple examples for SL-elliptic boundary 
value problems are the Dirichlet or the Neumann problem for Laplace operators. 

Let us now observe the specific homogeneity of boundary symbols. For u{t) G 
iL^(R+) we set 

(0.9) {K\u){t) X^u{\t), A G R-I-. 

In this way we obtain a strongly continuous group {ka}acm+ isomorphisms on 

the space i7®(R_^) (here, if Lf is a Hilbert space, a group {/^a}agr+ of isomorphisms 
: H H, X £ R_|_, with — k^xq for all A, ^ G R+, is called strongly 

continuous, if Kxh e C(R+, iL) for every h e H). 

It can easily be verified that 

( 0 . 10 ) (^d{A)(y, Xv) = X^Kx(JdiA)iy, t])k^^ 

for all A G R©. Similarly, we have 

(0.11) aa(Tj){y,Xr)) = r'A '"’ ka <78 (£,)(«/, »?)«;)( ^ = A^-' + iag(Tj)(?/,?7)/t^^ 

for all A G R©, where we employ the relation r' o kx = X^r' for the corresponding 
operators on functions in t on the half- axis. This gives us 

(0.12) aa{A){y,Xri) = diag(A^KA, A,'’''" , . . . , A)7^")«^a(4)(i/, 
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as the homogeneity of boundary symbols. 

On the manifold X we fix a Riemannian metric that is equal to the product 
metric from y x [0, 1) in a collar neighbourhood of Y. We then have the absolute 
values of covectors on X and Y in an invariant way. 

It is often convenient to unify the orders of trace operators by composing them 
from the left by classical pseudo- differential operators Rj on Y of order ji — [ij — ^ 
with homogeneous principal symbol such that 

Rj : ^ H^~^{Y,Gj) 

are isomorphisms for all s. Such a choice of Rj is always possible; we then talk 
about a corresponding reduction of orders on the boundary. 

Set ad{RjTj){y,r]) := ad{Tj){y,r]). We now replace the former T by 

^{RiTi , . . . , RnTn) and denote the new boundary value problem again by ^ = 
(^) . This gives us continuous operators 

F) 

(0.13) A:H^{X,E)^ 0 

H^-^{Y,G) 



for all sufficiently large s. 

For the boundary symbol (Td{A) we have 



(0.14) (Td{A){y,Xr]) = ad{A){y,rj)K^^ 



for all A G M+, {y, rj) G T*y \ 0, where 1 is the identity map in TTyG. 

There is now the following natural question. Given a a^-elliptic differential 
operator A : H^{X^ E) H^~^{X^ F) on X, does there always exist an SL-elliptic 
boundary value problem A = (y) with a suitable trace operator T1 The answer 
is negative, ‘unfortunately’ for many interesting geometric operators, e.g., Dirac 
operators in even dimensions, in particular, for the Cauchy- Riemann operator in 
the complex plane. For the existence there is a well known condition of Atiyah 
and Bott [3] that we want to recall here. First note that when A is cr^-elliptic, the 
boundary symbol 

(0.15) ad(A) : 'k^E' 0 i7"(M+) -> 0 iF-^(M+) 

is a family of Fredholm operators (surjective in the case of differential operators). 
Let S^'Y be the unit cosphere bundle induced by T*T with the canonical projection 
'Ki \ S*Y ^ Y . The restriction of (0.15) to S'^Y gives us a family of Fredholm 
operators parametrised by the compact set S^^Y . As such it represents an index 
element in the X-group of namely 

(0.16) ind5*raa(A)GX(5W), 

cf. [ 2 ] and Section 2.1 below. In the present case, L_|_ := ker era (A) is a vector 
bundle on T*F \0, and we have ind^^y <J^(A) = [L+js^y], where [. . .] denotes the 
element in the X-group on 5*Y, represented by the bundle in the brackets. Now 
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if there is a SL-elliptic boundary value problem A for A, i.e., the corresponding 
boundary symbol (0.7) is an isomorphism, we have necessarily ker5*ycra(A) 
U(j/.^)6S*y kerfTa(yl)(y,77) ^ tt^G, i.e., 

(0.17) inds.yaa(^) €<K(y), 

where : K{Y) K{S''Y) is the pull-back of K-groups under the projection 
7Ti : S*Y Y. In other words, (0.17) is a necessary condition for the existence of 
a SL-elliptic operator A for a -elliptic A. 

As noted before, the condition (0.17) may be violated. We also talk about a 
topological obstruction for the existence of SL-elliptic boundary value problems. 
The criterion of Atiyah and Bott says that (0.17) is also sufficient for the existence 
of a SL-elliptic A (in a slightly more general context, connected with a stabilisa- 
tion that we shall see more explicitly below in connection with pseudo-differential 
boundary value problems, cf. Section 2.1 below.) 

Boundary value problems for the case with non-vanishing obstruction for 
(7^{A) have been studied by many authors before, in particular, by Calderon [9], 
and Seeley [49] (more references will be given below), and many relations to other 
classical areas have been discovered, in particular, to the Riemann-Hilbert problem 
(and its various generalisations), Toeplitz operators, index theory, spectral theory, 
and geometric analysis. 

Among the essential observations there is the aspect that Fredholm operators 
of the form (0.13) (which are adequate for the SL-elliptic case) have to be replaced 
by Fredholm operators 



iL"-^(X, F) 

(0.18) A:H^{X,E)-^ 0 

P"-^(T,L) 

for a new scale of closed subspaces P^(Y, L) of H^iY, J), s G M, which are defined 
as the image under a projection : H^(Y, J) H^{Y, J) for a suitable element 
J G Vect(T), where G L°j(F; J, J) is a classical pseudo-differential operator of 
order zero (acting between distributional sections in J), cf. Schulze, Sternin and 
Shatalov [46]. Here L denotes the triple (Py, J, L), where L G Vect(T*T\0) is the 
image of TTy J under the projection : 7Ty J — > 7Ty J, the homogeneous principal 
symbol of P+ ; the symbolic calculus of classical pseudo-differential operators gives 
us p\ = p_|_ as a consequence of Py = P+, such that P is a subbundle of TTyJ. 
A well known theorem says that for every subbundle P C 7Ty J and every choice 
of a projection py : 7Ty J ^ P that is homogeneous in 77 of order zero there is an 
aissociated projection Py G L^\{Y; J, J) with py as homogeneous principal symbol 
(we will give a proof in Section 1.1 below). 

In the present exposition we shall extend an approach of the author [40] , where 
operators of the form (0.18) have been completed to an algebra of block matrix 
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operators 

T q) ' ® ^ ® 

'^/ p*-M(y,L+) 

by conditions of trace and potential type T and K, respectively, connected with 
suitable triples L± = {P±, J±, L±) of a similar meaning as before. The operator 
Q is a Toeplitz operator on Y, see the terminology in Section 1.1 below. Starting 
point will be an algebra B{X) of operators of the form 



(0.19) 



A = 



(0.20) 



A = 



A K 
T Q 



H^X,E) H^->^{X,E) 
0 -> © 
p*(r,j_) H^-f^{Y,j+) 



that are (classical) pseudo-differential boundary value problems on X with the 
transmission property at Y , cf. Boutet de Monvel [ 7 ] or Rempel and Schulze [ 31 ]. 
The operators (0.19) will be compositions 



( 0 . 21 ) 



KR. 

P+T P+QR- 



where R- : P® ^(T, L_) ^ H^{Y,J-) is the canonical embedding, and P+ ■■ 

^(y, J+) ^ ^(y, L_(_) is one of the chosen projections. Operators of the 

form (0.21) will be called boundary value problems for A with global projection 
conditions. In Section 1.2 we give a brief overview on the algebra B{X) including 
its symbolic structure. B{X) will be a subalgebra of the larger algebra of operators 
(0.21). In fact, for the case P± = id, L± = J± we just recover the case (0.20). 

Elliptic operators A on a manifold with boundary from the point of view 
of global projection conditions are of interest on their own right. On the other 
hand, manifolds with boundary may be viewed as particular manifolds with edges, 
where the boundary is the edge and the inner normal the model cone of a wedge. 
In general, wedges with non-trivial model cones (i.e., when they have a base of 
dimension > 0) locally describe manifolds with edges. In such a case ellipticity 
is also connected with edge operators of trace and potential type, and there is 
again a topological obstruction for the existence of SL-elliptic conditions, cf. [ 35 , 
Section 3.3.5, Proposition 10]. Similar phenomena may be expected on manifolds 
with higher (say, polyhedral) singularities with a hierarchy of obstructions for 
SL-elliptic conditions on the lower-dimensional strata. In all those cases it makes 
sense to construct operators with global projection data when the corresponding 
obstructions do not vanish. A joint paper of the author with Seiler [ 44 ] treats 
the case of manifolds with egdes. A substructure with special features is the case 
of boundary value problems without the transmission property, contained in the 
author’s joint paper with Seiler [ 45 ]. 

A large variety of examples of edge-degenerate differential operators with non- 
vanishing obstruction is constructed in Nazaikinskij, Schulze, Sternin and Shatalov 
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[27]. In another article [28] the authors study the ii"-theoretic nature of the topo- 
logical obstruction in general. 

In the present paper we will not discuss the aspect of edge operators in detail; 
this is another fascinating branch of the development of operators with global 
projection conditions and their index theory. Let us conclude this introduction by 
references for the case of smooth manifolds with boundary, namely Atiyah, Patodi 
and Singer [4], Melrose [26], Boofi-Bavnbek and Wojciechowski [6], Grubb and 
Seeley [17], Schulze, Sternin, and Shatalov [46], Schulze and Tarkhanov [47]. 

Acknowledgement: The author thanks T. Krainer and N. Tarkhanov from 
Potsdam as well as V. Nazaikinskii and B. Sternin from Moscow for valuable 
remarks on the manuscript. 



1. Elements of the classical calculus of boundary value problems 

1.1. Pseudo-differential and Toeplitz operators on a closed manifold. 

Let M be a closed, compact manifold, m — dim M, with a fixed Riemannian 
metric and an associated measure dx. Complex smooth vector bundles on M are 
assumed to be equipped with Hermitian metrics. For every E,F E Vect(M) we 
then have the space E) of square integrable sections in E with a correspond- 

ing scalar product. Moreover, we have the scale H^{M, E"), s G M, of distributional 
sections in E of Sobolev smoothness s, where we identify H^{M, E) with E). 

Let E^F E Vect(M x M) be the external tenser product of bundles E,F E 
Vect(M), i.e., E ^ F := (plE) <S) {p^F) with the projections pj : (xi,X 2 ) Xj, 
M X M M, to the j-th component, j = 1,2. We identify the space 
(where E* is the dual bundle of E) with the space E, E) of all operators 

K : C^(M, E) ^ C^(M, E) which have kernels c{x, x) in G^(E K1 E*), i.e., 

(1.1) Ku{x) = 

where means the fibrewise pairing between E* and E. 

We now recall some definitions and results from the standard pseudo-differen- 
tial calculus on a manifold. 

Definition 1.1. (i) The space S^{U x for p E R, and U C R"^ 

open, is defined to be the subspace of all a{x,^) E C^{U x R’^) such 
that 



/ 

Jm 



{c{x, x), u(x))Edx, 



( 1 . 2 ) \D^Dla{x,0\<c{0^-'^^ 

for all a E /? G N” and {x,^) E E x R^ for all KgzU, with constants 
c = c{a,p,K) >0; here (0 := (1 + The elements of *5'^(f7 x R^) 
are called symbols of order /i. 

(ii) X (R^ \ {0})) denotes the space of all a(^)(a:,^) G C^{U x (R’^ \ 

{0})) such that U(^)(x, A^) = A^a(^)(x,^) for all A G R+, {x,^) E U x 

(K" \ {0}). 
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(iii) An excision function x(0 is element of C^(IR^) such that 

x(^) = 0 for 0 < 1^1 < Co, xiO — 1 — Kl with certain constants 

0 < Co < Cl- 

(iv) A symbol a(x,^) G S^{U x M.^) is said to be classical, if there are 

elements G x (E^ \ {0})), j G N, such that 

N 

aKO e X R") 

j=0 

for every A G N, where xiO is ^ny excision function. Let x M^) 

denote the space of all classical symbols of order /i. 

Let fl C be open, and set 

:= {Op(a) : a(x,x',^) G x 0 x R")}, 

where Op(n)u(x) Jf ^^a{x^x\^)u{x') d^ — (27r)~'^d^, subscript 

‘(d)’ means that we talk about classical or non-classical symbols and operators, 
respectively. As usual, Op(a)i^(x) makes sense in the oscillatory integral sense, 
first as a continuous map: Op(a) : C^{Q) and then extended to larger 

function and distribution spaces. 

For A G ^ci(^) 

(j-^{A){x,i) = a(^)(a;,a;',0U'=x, 

(cf. the notation in Definition 1.1 (iv)) called the homogeneous principal symbol 
of order ji of the operator A. 

Let O , C^) denote the space of all k x j matrices of elements in 

L^^i)(0), and let E and F be vector bundles on M of fibre dimension j and k, 
respectively, with trivialisations Q x 0 and fl x for open sets D C E^, with 
transition maps 

(1.3) ri^^:Qxa : n x & n x & 

for open D,0 C E’^, with an underlying coordinate diffeomorphism k : D. 

We then have a push-forward 

of operators A : C^(0,O) — > C'°°(0,C^) to operators A : C^(0,O) — ^ 
C^{QX^) when we set A := where : C^(D,0) ^ C^{n,0) 

and : C‘^(0,C^) C"^(0,C^) are the isomorphisms induced by (1.3). To 

every chart y : D — > 0 on M we thus obtain the spaces E\dX\d) of 

pseudo-differential operators on D, acting between sections in the bundles E and 
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F. Set 



N 
j = l 

C € L~°°(M;£:,F)|, 

where {Di, . . . , D^v} is an open covering of M by coordinate neighbourhoods 
(say, diffeomorphic to balls), . ,(f]\[} a subordinate partition of unity, and 

{-^i , . . . a system of functions 'ijjj G C^{Dj) that are equal to 1 on snpp cpj 

for all j. 

Remark 1.2. E, F) is a Frechet space in a natural way. 

Let A G E, F), and let {^pq)i<p<j,i<q<k be a local representative of A 

on O. Then the system of matrices {cr^{Apq))i^p<j^i<q<k bas an invariant meaning 
as a bundle morphism 

(1.5) cT^iA):7rl,E^7rljF, 

called the homogeneous principal symbol of A; here, ttm : T*M \ 0 M is the 
canonical projection of the cotangent bundle of M (minus the zero section) to M. 

Let \ 0; E, F) denote the set of all morphisms : tt\^E '^mF 

such that P(^){x,X^) = A^p(^)(x,^) for all (x,^) G T*M \ 0, A G M+. 

Proposition 1.3. The principal symbolic map 

(1.6) <J^■.L>^^{M■,E,F)^S^^^\T*M\0■,E,F) 

is surjective, and there is a linear map 

(1.7) op : \ 0; E, F) ^ L^,(M; E, F) 

such that cr^ o op id. 

A choice of (1.7) directly follows from the existence of local operators in 
C^) associated with principal symbols that correspond to local repre- 
sentations of a given element in \ 0; F); a subsequent globalisation, 

according to the expressions in (1.4), then gives us (1.6). 

Theorem 1.4. Let M be a closed, compact manifold. 

(i) Every A G L^{M; E, F) for E,F G Vect(M) induces continuous opera- 
tors 



(1.8) A : H\M, E) F) 

for all s G M. 

(ii) A G E, F) and a^{A) = 0 implies A G L^^^{M;E,F), and 

hence the operator (1.8) is compact. 
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(iii) A € L^^^^(M;Eo,F), B G E, Eo) for E,Eq,E e Vect(M) im- 

plies AB G [M] F). In the classical case we have 

(1.9) a^{AB) = a^{A)a^{B). 

(iv) Let A G F), and let denote the formal adjoint of A 

{defined by {Au,v)l2^m,f) = {'^^ for all u G C^{M,E), 

V G C^{M^F)). Then we have A* G F^ E) and, in the classical 

case, 

( 1 . 10 ) a^{A^) = a^{AY, 

{the adjoint on the right hand side refers to the Hermitian metrics in 
the bundles.) 

In the sequel we mainly concentrate on classical pseudo-differential operators. 

Definition 1.5. Let A g L^i(M; E, F), la eR, E,F e Vect(M). 

(i) The operator A is said to be elliptic (of order yu), if a^{A) : f]^E 'e\^F 
is an isomorphism. 

(ii) An operator P G L~ff^{M\ E, E) is called a parametrix of A, if P satisfies 
the following relations: 

(1.11) Cl := I - PAe L-^{M-E,E), Cr I - AP e L~^ {M; E, F), 
where I denotes the corresponding identity operator. 

Notice that when P is a parametrix of A, we have cr^{P) — a^{A)~^ . 

Moreover, if A is elliptic, so is the formal adjoint A*. 

We call an operator A G L^^{M; E, F) underdetermined (overdetermined) el- 
liptic, if cr^{A) : ttI^E is injective (surjective). 

Remark 1.6. (i) A G Lf^{M] E, E) is underdetermined elliptic if and 

only if A* G L‘f^{M] E,E) is overdetermined elliptic. 

(ii) If A is underdetermined (over determined) elliptic, then the operator 
A* A G Llif{M-E,E) {AA* G is elliptic. 

Theorem 1.7. Let A G Lf^{M;E,E), la eR, E,E e Vect(M). 

(i) The operator A is elliptic {of order p), if and only if 

(1.12) A : P"(M, E) H^-^{M, E) 

is a Fredholm operator for an s = sq G M. 

(ii) If A is elliptic, (1.12) is a Fredholm operator for all s G M, and dim ker A 
and dim coker A are independent of s. We have V := ker A C C°°(M, E), 
and there is a finite- dimensional subspace W C C^{M,E) such that 

W + imA = iP-^(M,F) 
and W n im A = {0} for every s G M. 
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(iii) An elliptic operator A has a parametrix P G F, E), cf. Defini- 

tion 1.5 (ii), and P can he chosen in such a way that the remainders in 
the relation (1.11) are projections 

Cl : H^{M, E) -> F, a : F)^W 

to suhspaces V and W as in (ii) for all s G M. 

As a consequence of Theorem 1.7 (ii) we see that the index of A 
ind A := dim ker A — dim coker A 



is independent of s. 

Theorem 1.7 (iii) yields elliptic regularity of solutions u G E) to 

an elliptic equation Au = / G H^{M,F), s G E, namely u G E). In 

fact, using a parametrix F of A as a left parametrix, we obtain PAu = Pf G 
77®+^ (M, F), but Cl = I — PA implies PAu = u — Ciu where Ciu ^ F), 

and it follows that u = Pf + Ciu G F). 

The latter consideration gives us, in particular, V = ker A C C°^(M, E). More- 
over, the relation ker A* + imA = F) (which is a direct decomposition, 

i.e., ker A* fi imA = {0}) allows us to set W == ker A* c 0^{M^F)^ cf. Theorem 
1.7 (ii). 

The assertions of Theorem 1.7 (ii), (iii) have an abstract background which 
will be useful in other situations below. 

We consider operators A between Hilbert spaces that belong to scales 
where first 

(1.13) A:H^ ^ 

is continuous, := Hsgm every A there is an order // G E and a constant 

c > 0 such that (1.13) extends to continuous operators 

(1.14) A, : ^ 

for all s > c (the aspect with the constant c = c(A) is not relevant for Theorems 
1.4 and 1.7, but in boundary value problems it will play a role). If it is clear from 
the context which s is considered for the operator, we also write A instead of A^. 
We then assume the following properties: 

(i) There are continuous embeddings Hf ^ H- for s' > s that are compact 
for s' > s. 

(ii) The space is dense in for every s G E, i = 1, 2. 

(iii) If F C i — 1,2, is a finite-dimensional subspace and Cy : V 

a projection, then Cy induces continuous operators Cy : Hf ^ V for 
all s > c for some c G E. 

(iv) (1.13) extends to a Fredholm operator (1.14) for all s > c, and there is 
a continuous operator 



P :H^ 
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that extends to a parametrix 

^ Hf 

of As for every s > c, i.e., the remainders 

• I P P's — jx^r ’ — I -^sPs—jx 
induce continuous operators 

. ITS ^ rroc . Tjs — ii tjoo 

^s,l - -^1 ^ j ^s—fi,r • -^2 ^ ^2 

for all s > c. 



Remark 1.8. Under the abovementioned conditions the dimensions of kermis 
and coker As of the Fredholm operator A : ^ H 2 ~^ are independent of s > c, 

we have V := kei As C and there is a finite-dimensional subspace W C 
such that W im As = ^ W Dim As = {0} for every s > c. Moreover, the 

parametrix P can be chosen in such a way that the remainders 

Ci = I-PA, Cr = I-AP 
are projections to V and W, respectively. 



For references below we now prepare some well known material on parameter- 
dependent pseudo-differential operators. 

First we have the Frechet space E, F) of smoothing operators on M, and 

we set 

E, F; = <S(M^ L~^(M; E, F)) 

which is the space of smoothing parameter-dependent operators (between sections 
of E,F e Vect(M)). The space 

of parameter-dependent pseudo-differential operators of order /x is defined in a 
similar manner as (1.4), now for 

C(A) G L-°°(M-E,F-X) and Aj{X) e E\d,, F\dj-M), 

where the latter spaces are operator pull backs under charts \j ’ Dj ^ ft of 
operators on H, with matrices of amplitude functions aj{x, x'^ (f , A) G (fix fix 



Theorem 1.9. For every A{\) G L^{M; E, F;R^) and ly > fi we have 







(1 + |A|)^ 

(1 + IAl)/^-^ 



for u >0, 
for u <0 ’ 



for constants c — Cs^y > 0. 
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For classical parameter-dependent operators A{\) G L^^{M; E, F;R^) we have 
a parameter-dependent homogeneous principal symbol (1.5), now for the projec- 
tion 

7Tm : (T*M xR^)\0 M (0 means (^, A) = 0). 

In this case, A) is defined in terms of the homogeneous principal com- 

ponents of local amplitude functions in (^, A) ^ 0 (at x' = x). 

Definition 1.10. An A{\) e L^^{M;E,F;W) is called parameter-dependent 
elliptic (of order ^), if 

a^{A) : ttIjE -> 

for ttm ' {T*M X \ 0 ^ M, is an isomorphism. 

Theorem 1.11. Let A(A) e E, F;W) he parameter- dependent elliptic 

{of order p). 

(i) Then 

(1.15) A{\) : H^{M, E) H^~^{M, F) 

is a family of Fredholm operators of index 0. Moreover, there is a con- 
stant C > 0 such that the operators (1.15) are isomorphisms for all 
|A| > C. This holds for all s G M. 

(ii) A(A) has a parameter- dependent parametrix P{\) G {M\F,E\R}), 
i.e., 

1-P{\)A{\) G L~^{M',E,E-R^), 

1-A{\)P{\) G L-^(M;F,F;R^). 

Theorem 1.12. For every p there exists an element 

that induces isomorphisms 

i?^(A) : H^{X,E) ^ H^-^{X,E) 

for all s eR and A G 

Remark 1.13. If R%{^) ^ L'^^{M]E,E;R^) is an order reducing family of 
order s G M as in Theorem 1.12, then 

II^e(^)^IIl2(M,E) 

is a parameter-dependent family of norms on the space {M, E), equivalent to 
each other for different A G We shall employ such families in Section 3.3 bolow 
for constructing Sobolev spaces on an infinite cylinder M x M. 

We now turn to an extension of the concept of classical pseudo-differential 
operators L^^{M]E, F) to so called Toeplitz operators, acting between closed sub- 
spaces of Sobolev spaces on M. A crucial technical point is the following result: 
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Theorem 1.14. Let p : ^ ^ ^ Vect(M)^ he a projection, i.e., 

p^ = p, where p{x,X^) = p{x,\) for all (x,^) e T*M \ 0, X e M+. Then there 
exists an element P E L°^(M; J, J) such that = P, and (J'ijj{P) = p. 

Moreover, if p satisfies the condition p = p"^ , there is a choice of the associated 
pseudo- differential projection P E J, J) such that P = P* . 

Corollary 1.15. To every J E Vect(M) and every subbundle L C J there 

is an element P E J, J) such that = P, where cf^{P) : ^mJ t^mJ is 

a projection to L. 

The proof of Theorem 1.14 is based on the following general construction. Let 
P be a (complex) Hilbert space, C{H) the space of linear continuous operators, 
K{H) the subspace of compact operators in H. We then have the Calkin algebra 
C{H)/JC{H) and the corresponding canonical map tt : C{H) — > C{H)/JC{H). 

Lemma 1.16. Letp E C{H)/JC{H) be an element withp^ = p, and choose any 
Q E T{H) such that ttQ = p. Then the spectrum ctc{h){Q) of Q has the property 
that 

aciH){Q)n(c\m^{m 

is discrete. 

Proof. First observe that p^ — p implies cfc{h)/k{h(p) ^ {0} U {!}. In fact, 
for A E C\({0} U {!}) U there exists the inverse [Xe — p)~^ = p(X — 1)“^ + (^ ~ 
p)A“\ where e E jC{H)/JC{H) is the identity, e = n I for the identity I E C{H). 
Now U 3 A — > XI — Q E C{H) is a holomorphic Fredholm family in U, and 
XI — Q is invertible in C{H) for |A| > \\Q\\c(^h)- A well known invertibility result 
on holomorphic Fredholm families (cf. [35, Section 2.2.5] for a proof) implies that 
XI — Q is invertible for all A G P \ P for a certain discrete subset D (i.e., D is 
countable and D K finite for every compact subset K C U). □ 



Proof of Theorem 1.14. From Lemma 1.16 we see that there exists a 0 < 
^ < 1 such that the circle {A G C : |A — 1| — 6} does not intersect <T£(//)((5). 

Setting 



(1.16) 



P 



1 

27T2 




dX 



we obtain P^ — P and P G L^fM;J,J) as a consequence of the holomorphic 
functional calculus for L^^(M; J, J). Moreover, we have 






- p) ^ dX 



A- 1 






The second summand on the right hand side vanishes, while the first one is equal 
to p by the Residue theorem. 




356 



B.-W. SCHULZE 



To prove the second part of Theorem 1.14 we suppose p — p*. Then, if Pi = 
Pi G J, J) is any choice with rr^(Pi) = p, also Q P* Pi G J, J) 

satisfies a^{Q) = p*p = p^ = p. For Q we have Q = Q* > 0. Let ry be the spectral 
measure of Q. Then the projection P G J, J) defined by the formula (1.16) 

is equal to the spectral projection 

rj{Bs{l) n <T£(l2(m,j))( 0)) for Bs = {X e C : |A - 1| < 6}. 

In particular, we have P ~ P* — P^, and cr-tp^P) = p as before. □ 

Remark 1.17. The above construction of projections has a more general func- 
tional analytic background. If ^ is a Frechet operator algebra with a given ideal X, 
there is a lifting of idempotent elements of ^/X to idempotent elements in pro- 
vided some natural assumptions on the operator algebra are satisfied, cf. Gramsch 
[ 15 ]. In particular, for ^ == J) and X = J, J) the space ^/X is 

isomorphic to the space of homogeneous symbols of order zero. The general theory 
gives a characterisation of the space of all idempotent elements P G J, J) 

which belong to the connected component of a given idempotent Pi G J, J) 

and have the same homogeneous principal symbol as Pi. The result says that all 
those P have the form GPiG~^ , where G varies over the connected component of 
the identity in the group {/ + IG G : K G J, J)}, where denotes 

the group of invertible elements of J, J). 

Concerning more material and other observations on pseudo-differential pro- 
jections, see also the papers of Birman and Solomjak [ 5 ] and Solomjak [ 51 ]. 

Proposition 1.18. Let H he a Hilbert space, and let P,Q E C{H) he projec- 
tions such that P — Q is a compact operator. Then the restrictions of P to imQ 
and of Q to imP are Fredholm operators 

Pq : im (5 ^ im P, Q p : im P im Q 

between the respective closed subspaces of H, and Qp is a parametrix {i.e., a Fred- 
holm inverse) of Pq . 

Proof. The operator Q acts as the identity on imQ. Therefore, we have 

QpPq — 1 — QpPq — — Qp{Pq — Qp) : imQ ^ imQ, 

i.e., QpPq — 1 is a compact operator in imQ. It follows that Qp is a Fredholm 
inverse of Pq, and we see that both Pq and Qp are Fredholm operators. □ 

Let 

(1.17) ind(P,Q) 
denote the index of Pq : im Q im P. We then have 

(1.18) ind(P,Q) = -ind(Q,P). 

For every L G Vect (T*M \ 0) there is a J G Vect(M) and a projection p : 
TTyJ L with the property p(x, A,^) = p{x,^) for all (x,^) G T*M \ 0, A G M+. 




ELLIPTICITY WITH GLOBAL PROJECTION CONDITIONS 



357 



It suffices to set J = (the trivial bundle with fibre C^) for sufficiently large 

N. 

Set 

V{M) := {L := (F, J, L) ; Pe L° (M; J, J), = P, 

(1.19) J G Vect(M), L = im(7^(P)}. 

Incidentally, the elements of V{M) will be called projection data on M. 
Example 1.19. (i) For every J G Vect(M) we have 

(id,J,7T^J)GP(M). 

(ii) For L := (P, J, L), M (Q, G, M) G V{M) we have 

L 0 M (P 0 Q, J 0 G, L 0 M) G P(M); 

the direct sum for bundles is defined as usual. We then have L^^(M, J 0 
G) — J) 0 G), and P 0 Q in the latter space is again a 

pseudo-differential projection. 

(iii) For every L := (P, J, L) G P(M) we have a complementary element 

L-^ G P(M) in the sense that L 0 = (id, J, J). In fact, it suffices 

to write J in the form L 0 for a subbundle P-*- of J such that 

(iv) For L = (P, J, P) we can form an adjoint L* := (P*, J, P*) by defining 

P* G L^y{M; J, J) to be the formal adjoint of P, cf. Theorem 1.2 (iv), 
which is again a projection, and P* cr^(P*)7Ty J. 

Every element L = (P, J, P) G P(M) gives rise to continuous operators 

P : P"(M, J) ^ P"(M, J), 

s G M, and we set 

(1.20) P"(M,L) :=PH%M,J) 

which is a closed subspace of In fact, P^(M, L) is equal to the kernel 

of / - P : P"(M, J) ^ P"(M, J). 

Proposition 1.20. We have continuous embeddings 

(1.21) P^'(M,L) P"(M,L) 

/or all s' > s that are compact for s' > s. 

Proof. The inclusion in (1.21) is clear; the compactness follows from the fact 
that (1.21) may be written as a composition PG with the compact embedding G : 
P^'(M, L) ^ P^(M, J) and the continuous projection P : P^(M, J) ^ P^(M, L). 

□ 

Proposition 1.21. (i) The space P°°(M,L) = 

5e in P^(M, L) for every s G M. 
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(ii) Let P^(M; L) be equipped with the scalar product from = 

let V C P^(M, L) be a finite- dimensional subspace. Then 
the orthogonal projection Cy • P^(M, L) — > V induces continuous op- 
erators Cy : P^(M, L) ^ V for all 5 G M, and Cy is compact as an 
operator P^(M, L) P^(M, L) for every s G M. 

Proof, (i) Every u G P^{M, L) can be written asu Pv for a n G H^{M, J). 
Since C^{M^J) is dense in there is a sequence (un)neN C C^{M^J) 

such that V — limn^oo'i^n iR From the continuity of P we get u = 

limn^oo Un for Un Pvn G P^{M, L), and hence P^{M, L) is dense in P^{M, L) 
for every s. 

(ii) V C C^{M,J) is a finite-dimensional subspace. Hence, every projection 
Cy : V represents a compact operator Cy : 

for every s G M. The projection Cy : P^(M, L) P^(M, L) can be extended to a 
projection Cy := C^P • H^{M, J) H^{M, J) that is a compact operator. Thus, 

also Cy'-= PCy : P^(M, L) is compact. The operator Cn itself can 

be written as a composition Cy —Cy R, where R : P^(M, L) H^{M, J) is the 
canonical embedding. Hence, also Cy is a compact operator. □ 

Definition 1.22. Let L+ (P+, J+,L+), L_ := (P_, J_,L_) g P{M), and 
let R- : P^(M, L_) ^ denote the canonical embedding (given for 

every s G R). Then the composition 

(1.22) A := P+Ip_ 

for A G L[fj(M; J_, J+) is called a Toeplitz operator on M of order //. Let 
T^(M; L_,L+) denote the set of all Toeplitz operators (1.22) associated with 
L± G P(M). Set 

P-^(M;L_,L+) := {P+IP_ : A e J., J+)}. 

Remark 1.23. The space T^(M;L_,L+) can be identified with the quotient 
space J_, J+)/ where A\ ~ A 2 means P+AiP_ = P+^ 2 pL. 

Remark 1.24. Let A g L(^j(M; J_, J+) and form 

3 :=P+IP- GL^i(M; J_,J+). 



Then we have Pj^AR- = P+ A P-. 



Remark 1.25. Let A G J-^ Jj^)^ and choose elements L_,Li and 

L+,L+ in P{M) that are complementary in the abovementioned sense. Then, 
writing L+ = (P±, J±,T+) and L+ = (P+, J+,L+), we can decompose A into a 
block matrix operator 



(P^AR. ^ ^ 

P«(M,Lf) 
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where R- : P^(y,L_) ^ J_) and : P^(F,Li) H^(Y,J_) are the 

corresponding embedding operators. 

Applying that for an operator of the form 

I := P+IiP_ + P^IaP:^ e J_, J+) 

for any Ji, J 2 £ ^ci(^> we obtain A in the form 

(1.23) diag(P+IiP_, P 4 ^^ 2 P.^) € J_, J+). 

Toeplitz operators have been studied in the literature in many variants, see, 
for instance, Boutet de Monvel [8]. Note that 

(1.24) P+Ii?_ G T“^(M;L_,L+) P+IP_ G L-^(M; L_, L+). 

For every A G T^(M;L_,L+) written in the form (1.22) we have a bundle 
morphism 

(1.25) a^(A) :L_ ->L+ 

defined by the composition a^{A){x,^) p+(x, ^)(j^(A)(x, ^)r_(x, ^), where 

p+(x,^) = cr^(P+)(x,^), while r_(x,^) : (7 t^J_)(x,^) is the canonical 

embedding of fibres on (t,^). We then have a^(A)(j:, A^) = \^a^{A){x,^) for all 
(x,0 ^T*M\0, AgM+. 

Let \ 0;L_,L+) for L± G Vect(T*M \ 0) denote the set of all 

bundle morphisms ^ such that P(,j,){x,X^) = A^p(^)(x,^) for all 

(a:,^) G T*M \ 0; A G IR+ (we hope this notation does not cause confusion in 
connection with 5^^^(T*M\0; P, P) for P, P G Vect(M) which is an abbreviation 

Proposition 1.26. The principal symbolic map 

(1.26) (x^ : P''(M;L_,L+) ^ 5(''>(P*M \ 0; L_, L+) 
is surjective, and there is a linear map 

(1.27) op : S^^^\T*M\0■,L^,L+) ^ T^(M;L_,L+) 
such that o op = id. 

Proof. The map (1.26) directly follows from (1.6) when we represent ele- 
ments of T^(M;L_,L+) as P+AP_ and write cr^(P_^AP_) as <j^(P_|-AP_)|l_ , 
interpreted as a morphism (1.25). To see that (1.26) is surjective we choose a mor- 
phism which restricts to a given element G M \ 

0;L_,L+) (this is always possible), then form an operator A := op(a(-^)) G 
J^) such that cr^[A) = cf. formula (1.7), and finally set A \= 
P+AP_; then cr^{A) = □ 

Proposition 1.27. Every A g T^(M;L_,L+) induces continuous operators 

(1.28) A : P"(M,L_) -4 P"~^(M,L+) 
for all s G M. 
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This is an immediate consequence of the definition and of Theorem 1.4 (i). 

Proposition 1.28. Let A g T^(M;L_,L_^.) and suppose cr^{A) = 0. Then 
A G L_, and the operator (1.28) is compact for every s G R. 

Proof. We have P^AP- e J, J) and = 0. Hence 

Pj^AP- : J^) is a compact operator, cf. Theorem 1.4 

(ii). Thus P_|-(P+^P_) = Pj^AP- : P^“^(M, L+) is also compact. 

Finally, since P_ : P^(M, L_) ^ is continuous, also the operator 

P^AP-R- = Pj^AR- : P®(M, L_) ^ P^“^(M, L+) is compact. These conclu- 
sions hold for all 5 G M. □ 

Theorem 1.29. A g T^(M;Lo,L+), B g T'"(M;L_,Lo) /or L_,Lq,L+ g 
P(M) implies AB G T^"^^(M;L_,L+), and we have 

(j^{AB) = a^{A)a^{B). 

Proof. Writing L± = (P±, J±,L±), Lq = (Po, To, To), we have A — P-^ARq, 
B — PqBR- for certain A G Jo, J+), B G L^^(M; J_, Jo), with obvious 

meaning of Rq,R-. Then AB = P+APoTqPP- = P-APqBR-. Since APqB g 
J_, J+), cf. Theorem 1.4 (iii), we obtain AB G L_, L+). The 

symbolic rule is a consequence of relation (1.9). □ 

Given an operator A G T^(M;L_,L+), A = P^AR-, we define the formal 
adjoint 

p* I*p;, 

where A*, PI are the formal adjoints in the sense of Theorem 1.4 (iv), and R^ : 
P^(M; L!j_) — ^ is the canonical embedding. 

Theorem 1.30. A g T^(M;L_,L+) entails 

A* gT^(M;L;,L1) 

and 

cr^{A*) = (7^{Ay, 

where the adjoint on the right hand side refers to the Hermitian metrics in the bun- 
dles := <j^(P/)7TyJ+ and L*_ := cf^{PL)'KyJ-j induced by TTy Jy and 7TyJ_, 
respectively. 

Proof. It suffices to apply Theorem 1.4 (iv) and Definition 1.22. □ 

Definition 1.31. Let A e T^(M;L_,L+), /i g M, L± = (P±, J±,T±) G 
P(M). 

(i) The operator A is said to be elliptic (of order /x), if a^{A) : L- 
is an isomorphism. 
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(ii) An operator B e T ^(M;L+,L_) is called a parametrix of A, if B 
satisfies the following relations: 

(1.29) Cl := I~BA e L_, L_), Cr := I - AB C L+, L+), 

where I denotes the corresponding identity operators. 

Remark 1.32. For every L := (P, J, L) e P(M) and every /i G M there exists 
an elliptic operator G T^(M;L,L). 

In fact, let G \ 0; J, J) be the unique element that restricts to 

the identity map on tt]' J, with tti : S*M M being the canonical projection of 
the unit cosphere bundle S'*M to M. Set A := op(u(^)), cf. the formula (1.7). Then 
PAR for the embedding R : P®(M, L) — > J) is elliptic because a^{PAR) : 

L ^ L is an isomorphism. 

Theorem 1.33. Let A e T^(M;L_,L+), /i g M, L± = (P±, J±,T±) G P(M). 

(i) The operator A is elliptic {of order p) if and only if 

(1.30) A : P"(M,L_) P"“^(M,L+) 

is a Fredholm operator for some s = sq G M. 

(ii) If A is elliptic, (1.30) is Fredholm for all s G M, and dimkeryl and 
dim coker ^ are independent of s. 

(hi) An elliptic operator A G T^(M;L_,L+) has a parametrix B in the 
space T”^(M; L+, L_), and B can he chosen in such a way that the 
remainders in the relation (1.29) are projections 

Cl : P"(M,L_) -.1/, Ci: P"“^(M,L+) IF 

for all s G M, for V ker A C P^(M, L_) and a finite- dimensional 
subspace W C P^(M, L+) with the property IF + imA = P^“^(M, L+) 
and IF n im A = {0} for every s G M. 

The proof of Theorem 1.33 will be given below. First observe that for arbitrary 
h± — {P±, J±, L±) G V{M) there exist elements M± = (Q±,C^,L±) G V{M) 
such that 

(1.31) T^(M;L_,L+) = T^(M;M_,M+). 

In fact, for m sufficiently large, J± may be represented as subbundles of the 
trivial bundle with complementary bundles and projections ^ 

7T^ along 7T^ and associated pseudo-differential projections 

P± G L°i(M;C"^;C"^), P± : W{M,C^) W{M,J±). 

Moreover, the compositions of projections 

<yAP±)cJ^{P±) := ^^(Q±) : ^ ^mJ± ^ L± 

are again projections, and Q± '.= P±P± G L^^(M; C"^) are associated pseudo- 

differential projections, Q± : H^{M,C'^) — > P®(M, L±). Relation (1.31) is then 
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obvious when we use that every A E L^j(M; J-j-) can be identified with an 
element AE C^, by ^ = AP-. 

Proposition 1.34. Let A E T^(M; L_,L_i_) be an elliptic operator, and let 
us represent A as an element A E T^{M\ M_,M+) for M± := (Q±, C^, L±) for a 
sufficiently large m. Then there exists an elliptic operator A^ E T^(M; M:!:, Miji) 
for suitable E V{M) such that A 0 A-^ E L^{M;C^,C^) is elliptic in the 
sense of Definition 1.5 (i). 

Proof. Let us write the bundles L± as subbundles of the trivial bundle 
on T*M\0 in such away that L_ = {0} for every {x,^) E T*M\0. 

We then have a, G E Vect(T*M \ 0) such that L_ 0 ® G = C^. Let us define 

an isomorphism 

(1.32) (L_ 0 L_(_ 0 G)\s*m {L-^ 0 L_ 0 

by diag(o-^(yi)|s.M,'7^^(^)|5*M,idG|s.M)> Li := L+ © G, L| := L_ © G, 
and define \ 0; Li, to be the unique element such that 

= diag((7,^^(^)|s.M,idG|s.M)- Moreover, set 

Mi:=(Qi,C™,Li). 

By definition, the operator A has the form A = Q^AiR- for some element 
Ai E C^), where R- : P^(M, M_) ^ H^{M,C'^) is the canonical 

embedding. Moreover, let ^ M \ 0;C'^ ,C^) denote the unique 

element such that cf^{A 2 )\s*m coincides with (1.32). Then, applying (1.7) to 
<^- 0 (^ 2 ), we obtain an associated elliptic operator A 2 E with 

R^ : P^(M, Mi) H^{M,C^) being the canonical embedding, where (j^{A^) 
coincides with the abovementioned symbol. The operator 

A\— A® A^ — d\ag{Qj^AiR-,Qf^A2R^) 

can be identified with 

Q+IiP_ 0 QIA2P^ : P"(M, C"^) C^), 

i.e., as a sum of standard pseudo- differential operators, cf. the formula (1.23), and 
hence belongs to L^^(M; C"^), and A is elliptic, since a^{A) = a^{A 2 ). □ 

Proposition 1.35. Let Aj e T^~-^(M;L_,L+), j E N, be an arbitrary se- 
quence. Then there exists an A E T^(M;L_,L+) such that 

N 

(1.33) A- 

i=o 

for every N eN, and A is unique mod T~^(M;L_,L_|_). 
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Proof. By definition, every Aj has the form Aj = P^AjR- for suitable 
Aj G (M] J-., J^). A well known result on standard pseudo-differential op- 
erators says that there is an A G J-, J^) such that A — ^ 

^ci every AT G N, and A is unique mod L~’^{M] J^). 

We set A := P^AR-] then the relation (1.33) holds. Moreover, if an element 
A' G T^(M;L_,L+) satisfies (1.33) with A' in place of A, we have A — A' = 
P+(A-A')i^-, where P+(I-A')P- G CijeN J_, J+), 

and hence, A — A' e T“^(M; L_,L+), by virtue of (1.24). □ 

Proof of Theorem 1.33. First assume that A e T^(M;L_,L+) is elliptic. 
According to the relation (1.31), without loss of generality we may assume h± = 
(P±,C"^,L±) for some sufficiently large m. Applying Proposition 1.34 we find 
an elliptic element G T^(M; Liji, L:^:) such that A — A® A^ is elliptic in 
L^j(M; C"^, C"^). We now choose a parametrix P G L~^^(M; C"^) in the sense 

of Theorem 1.7 (hi) and set Pq •= P_PP+ G T“^(M; L_|_, L_). Writing A = 
P AR- we obtain 



C? :=I- BqA = I- P_PP+P+AP_ 

= / - P_PP+AP_ 

which yields a^{C^) = 0, i.e., Cf G T~^{M; L_, L_). In a similar manner it follows 
that := /- APo € T-^(M;L+,L+). 

By virtue of Proposition 1.28 the operators Ci G P(P^(M, L_)) and G 
£(P^“^(M, L+)) are compact. Thus (1.30) is a Fredholm operator for every s G M. 
Applying a formal Neumann series argument we find a A G T“^(M;L_,L_) such 
that K ~ — cf. Proposition 1.35. 

For Bi \= (I — K)Bq G T~^(M; L-^, L_) we then obtain Q := / — P^A G 
T“^(M; L_, L_). In an analogous manner we find a P^. G T“^(M;L+,L_) such 
that Cr •= I — ABr G T“^(M; L_, L_). A standard algebraic argument shows 
that Bi is a two-sided parametrix of A. In fact, P^A = / — C/ implies ABiA = 
A — AC I and ABiABr — ABi{I — Cr) — ABr — AClBr] then Theorem 1.29 and 
relation AP^ = / mod T“^(M; L+, L+) yield ABf — / mod T“^(M; L+, L+). 
Propositions 1.20 and 1.21 together with the first part of the proof allow us to 
apply Remark 1.8 to the present situation. This gives us the assertions of Theorem 
1.33 (ii), (iii). 

It remains to show the second part of Theorem 1.33 (i), namely that the 
Fredholm property of (1.30) for an s = sq G M implies the ellipticity of A. Without 
loss of generality we may assume Sq — /i = 0. In fact. Remark 1.24 gives us elliptic 
operators 

R~^_° : P°(M,L_) ^ L+) -4 P°(M,L+). 

These are Fredholm operators by the first part of the proof of Theorem 1.33. 
Thus, also ^0 : Rl°~'"AR^y : P°(M,L_) ^ P°(M,L+) is Fredholm. If we show 
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the ellipticity of Aq, we obtain at once the ellipticity of A, because ellipticity 
remains preserved under compositions. In other words, we may consider the case 
A:=Ao, 

(1.34) A: P°{M,L^) ^ P^{M,h+). 

Moreover, let 

(1.35) E : P°(MM) 

be the identity operator, cf. the notation in Remark 1.25. 

We have 

(1.36) U(M, J-) =J^°(M,L_)©pO(M,Li), 
and there are continuous embeddings 

(1.37) R+ : P°{M,h+) L^{M,J+), Ri : P^{M,L^) L\M, J-). 

Then we can pass to the operator 

^ {^0 A) (o p) ^ 

which is an element of L^^(M ; J_, 0 J_). By assumption, the operator (1.34) is 

Fredholm. In particular, there is an operator Q : P^(M, L_(_) — > P^(M, L_) such 
that I — QA : P^(M, L_) P^(M, L_) is compact. 

Let S : L‘^{M, J+0 J_) ^ P^(M, L+)0P°(M, L:^) denote a projection. Then 
T diag((5, E) o S has the property that I — TB =: K is compact in L‘^{M, J_). 
Since I — K is a. Fredholm operator, we have dimker(/ — K) < oo, and then 
dimkerP < oo, since Bu = 0 implies TBu — 0 which yields (I — K)u — 0, i.e., 
kerPCker(/-P:). 

The operator B := B*B : L‘^{M, J-) ^ J_) belongs to J_) and 

is self-adjoint and Fredholm. 

From Theorem 1.6 (i) we know that B is elliptic. It follows that a^{B) is 
injective. Hence, also a^{A) is injective. By passing to adjoint operators, in an 
analogous manner we can show that cr^{A) is also surjective. 

This completes the proof of Theorem 1.33. □ 

We now discuss the question to what extent the specific choice of projections 
P± in an elliptic operator A G T^(M;L_,L+) may affect the index. This is an 
aspect on more general properties of Fredholm operators and projections in Hilbert 
spaces, see, for instance, [45]. 

Let and H- be Hilbert spaces, and let G T(P_^) and P-,Q- G 

C{H-) be continuous projections, such that P± — Q± are compact operators in 
H±. 



Theorem 1.36. Let A g £(P_,P+) such that 
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is a Fredholm operator. Then, also 

B := Q-\-A : imQ_ ^ imQ+ 
is a Fredholm operator, and we have 

(1.38) ind A — ind^ = ind(P_, Q_) — ind(P+, Q_^), 
cf. the notation (1.17). 

Proof. From Proposition 1.18 we know that 

P- : imQ_ imP_ and : imP+ ^ imQ^. 

are Fredholm operators, and Q_ is a Fredholm inverse of P_. Thus Q-P- : 
im Q_ im Q_ is a Fredholm operator of index zero. An analogous observation 
holds for the projections Q^,P^. Thus, the operator 

D : imQ- imP_ imP+ imQ^. 
is Fredholm of index 

(1.39) indP = ind A + ind(P_, Q-) — ind(P+, Q+), 
cf. the relation (1.18). We have 

D = (Q+P+)P(Q_P_) 

- g+[P+,Q+]lQ_P_+Q+P+A(l-g_)P_, 
where [P^_,Q+] is the commutator in which is compact, since 

[p+,g+] =: p+g+ — Q+P+ 

= (p+-g+)(i-Q+-p+). 

Moreover, (1 — Q_)P_ = {P- — Q-)P^ : P_ — ^ H- is compact. Hence the 
operator (Q+P+)P(g_P_) — P is compact, i.e., (Q+P+)P(g_P_) is Fredholm, 
and we have 

(1.40) indP = ind((34.P+)P(Q_P_). 

By virtue of Proposition 1.18 the operators Q-P- : imQ_ ^ imQ- and Q+P+ : 
imQ+ ^ img+ are Fredholm and of index zero. Therefore, we have indP = 
ind(Q+P-^)P(g_P_), and the eissertion is a consequence of the relations (1.40) 
and (1.39). □ 

Corollary 1.37. Consider elliptic operators A G T^{M;h-,h^) for h± := 
(P±, J±,L±) and B G T^(M;N_,N+) /or := {Q±^ J±^L±), and assume that 
a^{A) = a^{B). Then the Fredholm indices of A and B as operators 

A : P"(M,L_) ^ P"-^(M,L+), B : P"(M,N_) ^ P"~^(M,N+) 

are related by the formula (1.38). 
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Remark 1.38. Given projection data L := (P,J,L) and M (Q,J,L) G 
V{M) (with the same J^L but different projections), the operators 

(1.41) P : P"(M,M) ^ P"(M,L), Q : P"(M,L) ^ F"(M,N) 

are Fredholm, and Q is a Fredholm inverse of P (and vice versa), cf. Proposi- 
tion 1.18. We have 

P€T°(M;M,L), Q€T°(M;L,M), 

P and Q are elliptic of order zero, and hence, in particular, the Fredholm indices 
(as well as the dimensions of kernel and cokernel) of (1.41) are independent of s. 

Remark 1.39. Let Aq^Ai g T^(M;L_,L+) be elliptic, and assume that the 
principal symbols 

(j^{Ai) \ L- ^ 

coincide for z = 0, 1. Then we have 

ind^lo = ind^i. 

In fact. Proposition 1.28 gives us cr^(Ao — A\) = 0, i.e., 

6T^-1(M;L_,L+), 

and hence Aq is equal to modulo a compact operator. 

Let us now assume that 

L±(t):=(P±(^),J,L±(0), 0<^<1, 

is a family of elements in P(M), where 

P±(-)eC([0,l],L°(M;J,J)) 
are families of projections, such that 

L±{t) = (Ti,{P±{t))Tr*MJ± 

are families of subbundles in Let us assume that 

is a continuous family of isomorphisms, smooth in (x,^) G T*M \ 0 and homoge- 
neous of degree fi. We can complete (t) to a continuous family of morphisms 

such that can be identified with cr^(P+(t))a(^)(t)cr^(P_(^)) for every t. 

Let us set At := op(S(^)(t)), cf. Proposition 1.3, which gives us an element of 
C([0, 1],L,^^(M;J_,J+)). 

We then obtain a family 

At := P+(t)I(t)P_(t) G T^(M;L_(0,L+(t)) 

with R^{t) : P-{t)H^{M^ J_) H^{M^ J_) being the canonical embeddings. The 

operators At are elliptic for all t G [0, 1]. 
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Theorem 1.40. Under the conditions on At G T^(M; L_(t),L+(t)), 0 <t < 
1, mentioned above we have 

ind Ao = ind Ai, 

where the index of At refers to the Fredholm operator 

At : P-{t)H^{M,J^) ^ P^{t)H^-^{M,J^). 

Theorem 1.40 has a more general functional analytic background. The fol- 
lowing considerations up to Remark 1.43 have been contributed to this paper by 
Thomais Krainer from the University of Potsdam. 

Theorem 1.41. Let H and H be Hilbert spaces, and consider families of 
operators {At)o<t<i G C{[0,1], P)), 

{Pt)o<t<i G C{[0A],C{H)) and {Qt)o<t<i G €{[0,1], C{H)). 

Assume P^ — Pt, Q\ — Qt for all t G [0, 1]. Moreover, let 

PtAtQt AmQt ^ im Pt 

be a Fredholm operator for every t G [0, 1] . Then we have 

ind(PoAoQo : imQo ^ imPo) = ind(PiAiQi : imQi imPi). 

To prove this theorem we first show another result. Consider the set 
(1.42) U{H) X C{H, H) X U{H), 

where II (P) for a Hilbert space H denotes the set of all P G C{H) such that 
P^ = P. Let ^k{H,H) denote the set of all triples (P, A,Q) in (1.42) such that 

PAQ : im Q im P 
is a Fredholm operator of index k. 

Proposition 1.42. For every /c G Z the set ^k{H,H) is open in (1.42). 

Proof. As is well known, the set of Fredholm operators of index k between 
Hilbert spaces L and L is open in C{L,L). Applying this to L \= imQ and L \= 
imP, it follows that for a triple (P, A, Q) G ^fe(P, H) there exists an eo > 0 such 
that (P,A-hP,0) G ^k{H,H) for every K G \\K\\ < sq. 

We now prove that for every 

(1-43) (P,A,Q)G^fc(P,P) 

there exist constants a>0,s>0,/3>0, such that 

(M, P, N) G H(P) X JT{H, H) X H(P) 

and 

\\M-P\\<a, \\B-A\\<e, \\N - Q\\ < 0 



imply 

(1.44) 
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Let G G C{H)jG G C{H) be invertible elements, such that 
(1.45) \\G-I\\<6u \\G-I \\<62 

for sufficiently small 61,62 < 1. Set 

M := GPG~\ N := GQG~\ 

We prove that relation (1.44) holds for e and 61,62 so small that 



(1.46) 



1 + ^2 , 4 - <^2 I, 

-^+ ^||A|| < £0 



1-61 1-61 

holds. From Neumann series arguments we obtain 

(1 47) 11/^— 111 -- 11/^— 1 7-11 - 

and 






(1.48) ||G|1<1 + <52. 

We now reformulate the operator MEN as follows: 

(1.49) MBN = GP{A + K)QG~'^ = G{PKQ + PAQjG-'^ 
for 

K := G~^B - A)G + (G'^ - I)A + A{G - I) + {G~^ - I)A{G - I). 

Let us verify that Hit'll < sq. In fact, using (1.45), (1.46), (1.47), (1.48), we obtain 
||K|| < ||G-i|| ||S-^|| ||G|| 

+ ||G-^-/|| 11^11 + PH ||G- ill 
+ IIG-i-ill PH ||G-i|| 

< + ^2) + + '52IMII + Y^<52||^|| < £0. 

Thus, from the first part of the proof it follows that {P,A K,Q) G 
Moreover, (1.49) together with the isomorphisms 

G : im P ^ im M, G : im N ^ im Q 

gives us the relation (1.49). 

Let us finally consider the map 

s:n(P)->£(P), 

defined by s{M) := MP + (/ — M){I — P). The map s is continuous, and we have 
s(P) = 7. Let us choose > 0 in such a way that \\s{M) — s{P)\\ < 6i holds when 
II M — P|| < (^ 1 . Since < 1 is very small, we have the inverse s{M)~^ G C{H) 
for \\M - P\\ <6i.We then obtain Ms{M) - MP = s{MP), i.^, M = GPG~^ 
for G := s{M). In a similar manner it follows that ||N — Q\\ < 62 for a suitable 
small (^2 > 0 implies N — GQG~^ for an invertible G G C{H), ||G — 7|| < 62- This 
completes the proof of Proposition 1.42. □ 
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Proof of Theorem 1.41. By virtue of Proposition 1.42 the map [0, 1] ^ Z 
defined by t — > ind Ft At Qt is continuous and hence constant. 

□ 

Remark 1.43. Theorem 1.41 can be generalised to the case when [0, 1] is 
replaced by any connected topological space X. It follows that the index of Fred- 
holm operators PxA^Qx : imQx ^ imPa: which are continuously parametrised by 
X G X, is constant. 

1.2. Operators with the transmission property at the boundary. In 

this section we prepare some necessary material on symbols and operators with the 
transmission property at the boundary and establish a connection with operators 
on the boundary with operator- valued symbols. 

Let Q CW B y he open, and let P Q x R 3 x = {y ,t) ^ ^ 

Set 

H^oc(y){U) ■■= {u e HUU) : ¥>«GF^(R‘'+')for 

every if(y) e C^(n)}, 

and define 

H!orap(y){U) := {u € H^U) : e for 

every tp{t) £ C~(K)}. 

Moreover, set 

-^comp(y)(^ ^ ^±) •“ ^comp(y)(^ ^ • 

Definition 1.44. A symbol a(x,^) G S^^{U x for ^ G Z is said to have 

the transmission property at t = 0, if the homogeneous components 
satisfy the following relations: 

DtD^{a(y-j){y,t,V,T) - -r], -t)} =0 

for y G D, t = 0, 77 == 0, r G M \ {0}, for all A: G N, a G W, and for all j G N. 

Let S^^{U X denote the space of all symbols a(x,^) G S^^{U x 

with the transmission property at t = 0. Moreover, set 

X 1± X := ^ ^ S^,{U x 

Remark 1.45. S^^{U x R^+^)tr is a closed subspace of S^^{U x analo- 
gously, X X R^+^)tr is closed in x R± x R^+^). 

To illustrate the structure of the transmission property we want to have a look 
at the one-dimensional case, say on R+ x R (the case R_ x R is analogous; the 
transmission property is an invariant condition with respect to the refiection map 
t — > -t). 
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Definition 1.46. Let a{t,r) G x R), /j, e Z, and write the component 

t) of a(t, r) of homogeneity /j, — j in r 0 in the form 

a(^^_j){t,T) = {e+(T)a+(^) + e■(r)aJ(^)}r^“^ 

j G N; here is the characteristic function of R± 3 r. The symbol a{t, r) is said 
to have the transmission property at t == 0, written a{t,r) G *S'^i(R+ x R)tr, if 

(1.50) £)*a+ {t)\t=o = Dtuj (l)|i=o for all j, keN. 

Remark 1.47. Definition 1.46 can also be written as follows. 

A symbol a(t, r) G x R), /x G R, belongs to *S'^i(R+ x R)tr if and only if the 

coefficients af{t) G C°^(R+) in the expansion 

00 

a{t,r) ^ for r — ^ ±00 

j=0 



satisfy the condition (1.50). 

Proposition 1.48. Let a{y,t,r],T) g x R+ x R^+^), and set 

for every fixed {y^y) G OxR^; then we have G *S'^j(R+ xR). The following 

conditions are equivalent: 

(i) a{y,t,y,r) G x R+ x R^+^)tr; 

(ii) a^,^(Lr) G x R)tr for every {y,y) G H x R'?. 

Proof. Let us first assume the condition (i). Then the symbol ay^rj{t,r) be- 
longs to the space S^fiR-^ x R)tr in the sense of Definition 1.46 if and only if 
{x{rj,T)a(^y_j){y,t,r},T))y^r] has this property for any excision function y, for all 
j G N. Since y is equal to 1 for |?7,r| > const for some constant > 0, it suffices 
to show that the symbol (a(^_j)(y, t,ry, for 77 0 has this property. Let 

ly := y — j ^OT any j G N. Let us consider, for simplicity, the case of symbols which 
are independent of (t,7/); the general case is easy as well and left to the reader. 
By assumption, we have 

(1.51) il“a(^)(?7,T)|^=o,r7^o = D^{{-l)''a(^)i-V,-T))U=o,TTio 
or, equivalently, 

(1.52) (i)>(.))(0, 1) = (-l)'^+l“l(P“a(.))(0, -1) 

for all a G N^. Set p := |t|“\ and consider the expansion of a(^)(r7, r) for r — )■ 
±co. We have 
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= a(^,){p ^pr],p i) = p '^a(^)(p»7,l) 

a 

OO Q, 

= E{ E ^>0’ 

fc=0 |a|=fe 

a.(y){p~^ pT], -P~^) = p~‘'a^u){pv, - 1 ) 

a 

OO Q, 

E{ for T<0. 

/c=0 |a|=/c 

By virtue of (1.52) we then obtain (i) (ii). On the other hand, (ii) gives us 

immediately the relation (1.51), i.e., we have also proved (ii) (i). □ 

Let e^ be the extension operators of functions on E± by zero to the opposite 
sides (applied to elements in x R±) for s > — |). Moreover, let r=^ denote 

the operator of restriction to 0 x R± (applied to distributions in x R). 

Set 

(1.53) Op”^(a)n(x) := r^ Op(a)e^u(a:) 

for a G X x M^+^)tr, a G x E x E'^+^)tr, such that xE^+f ~ 

Clearly, (1.53) is then independent of the specific choice of a. We form (1.53) first 
for u G C^(n X E+) and then for u G ^comp(7/)(^ ^ ^+)? s > — ^, cf. Theorem 
1.56 below. Similarly, we consider operator families on the half- axis 

(1.54) op+(a)(t/,? 7 ) := r+ op(a)(y, ? 7 )e+, 

where op(d)u{t) := ff ^^a{y^t,r]^T)u{t')dt'dr^ d G x E x E^+^)tr- 

op+(a)(y, 77 ) will be regarded as an operator- valued symbol. 

Let iL be a Hilbert space, and let {ka}acm+ be a strongly continuous group of 
isomorphisms k\ : H ^ H , i.e., K\h ^ (C(E+, iJ) for every h e H, and K\Kp — Kxp 
for all A,p G E+. To have a simple notation, we say that H is endowed with a 
group action. As is known, there are constants c > 0 and M such that 

(1.55) \\f^x\\£{H) < c(max(A, A“^))^ for all A G E+. 

More generally, if F is a Frechet space, written as a projective limit of Hilbert 
spaces F = with continuous embeddings ^ for all k, and if 

is endowed with a group action {/^a}age +5 such that {/^A|j/^}AeE+ is a group 
action on for every /c, we say that F is endowed with a group action. 



and 
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Example 1.49. (i) The space {:= is endowed with 

the group action {K\u){t) = Xiu{Xt),X G M+. The same is true of the 
spaces {t)-^H^{R+) := : u G i^"(M+)}. 

(ii) The Frechet space *S(E+) (:= 5(E) |^^), written as 

5(1+) = \jm{t)-^H^{R+), 

keN 

is endowed with the group action defined as in (i). 

Definition 1.50. Let {F, {/^a}agm+} and {H,{Kx}xeR+} t>e Hilbert spaces 
with group actions, moreover, let 17 C E^ be open, and /i G E. 

(i) The space 5^(0 x R^',H,H) is defined to be the set of all a{y^rj) G 
C^{ft X R^, C{H, H)) such that 

for all a e W, l3 e W and {y,r]) e K x R^ for all KazQ, with con- 
stants c = c{a,(5,K) > 0. The elements of 5^(0 x R^-.H^H) are called 
operator- valued symbols of order fjL (associated with the given group 
actions). 

(ii) X (E^ \ {0}); i7, H) denotes the space of all a(^^>^{y,rj) G x 

(E^ \ {0}),C{H,H)) such that a(^)(y,Ar/) ^ A^^Afl(^)(^, ? 7 )k^^ for all 
AgE+, (y,ry)Gf2x(En{0}). 

(hi) A symbol a{y, r]) G 5^(17 xR^; H, H) is said to be classical, if there are 
elements a(^^_j^{y,r]) G x (E^ \ {0}); if, if), j G N, such that 

N _ 

<y,r,) -J2xiv)ai,-j){y,v) e X 

j=0 

for every G N, where xiv) is any excision function. Let 5^^(17 x 
E^; if, if) denote the space of all classical symbols of order ji. 

Let us extend this notation to the case of Frechet spaces with group actions 
as follows: If F := is a Frechet space with group action {^a}agm +5 we 

set 

(1.56) X := f] x W-H,W). 

jeN 

Moreover, if also F — if ^ is a Frechet space endowed with a group 

action {aca}agm +7 we first fix a function r : N ^ N and set 

X R‘>-,F,F)r := fl x ■, W ) . 

j€N 



(1.57) 
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Then we define ^ F) to be the union of (1.57) over all r. Similarly, 

we have the spaces x (R^ \ {0}); F, F). 

Theorem 1.51. Let Q C W be an open set, and fix a symbol a{y,t,rj,r) G 
s^,{n X 1+) tr, At G Z, that is independent of t for t > c for a constant c > 0. 

(i) We have 

(1.58) op+(a)(i/,7?) G S^(n X R^;F"(R+),7F-^(R+)) 
for every real s > — and 

(1.59) op+(a)(y,Tj) G S^(Q x R^;<S(1+),<S(R+)). 

The operator- valued symbol op^(a)(y,p) is classical, when the symbol 
a is independent of t. 

(ii) Let U(^_j)(t/, t, ? 7 , r) G ^ (Q x R_|_ x (R^+^\{0})) be the homogeneous 
component of a{y, t, rj, r) of order p> — j. Then we have 

op+(a(^_,)|t=o)(2/,r?) € x (K« \ {0}); i/*(K+), H^-^+^(R+)) 

for every s > — ^, and 

op+(a(^_,)|t=o)(y,r?) G X {W \ {0});5(1+),5(1+)). 

The technicalities to prove Theorem 1.51 can be found in [ 39 ]. 

We now turn to pseudo-differential operators that are associated with symbols 
a(y,y',v) G xfl xW^]H, H) (for simplicity, generalities will be formulated 

for the case of Hilbert spaces H, H with group actions; the case with Frechet spaces 
is analogous and will tacitly be used below). 

Let 

(1.60) := {Op(a) : a(y,y',r]) G 5(%(Q x Q x R^;F,F)}, 

where Op{a)u{y) := ff e'^^y~y^'^a{y,y' ,rj)u{y')dy'dr], drj = {27r)~^dr]. 

Definition 1.52. Let {F, {/^A}AeM+} be a Hilbert space with group action. 
Then W^(R^, H) for s G R is defined to be the completion of S{W,H) (or, equiv- 
alently, of C^(R^,F)) with respect to the norm 

llwllw-CR-.H) = |y ivf"\\i^lrl)^{ri)\\Hdri^ , 

{u{rj) denotes the Fourier transform of u with respect to y G R^). 

The spaces W^(R‘^,F) have been introduced in [ 34 ] in connection with oper- 
ators on manifolds with edges, see also [ 33 ], and their properties are studied, for 
instance, in [ 35 ], [ 39 ], [ 21 ], [ 50 ]. Let us summarise some results in the following 
theorems. 

Theorem 1.53. Let H be a Hilbert space with group action {aca}agm+; 
s G R. 
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(i) We have 

W\W,H) = {« e S'{W>,H) ; {T]rnJ^]uiv) € 

where S'{R'^,H) := £(5(R’),ff). The space W®(R«,iI) is a HilbeH 
space with the scalar product 

{u,v)woiR^,E) = 

(ii) The operator of multiplication M^p hy a function (p G S{M^) induces a 
continuous operator 

Mp : ^ 

and p Mp represents a continuous operator S{R^) C(W^ , H)) . 

(iii) ixx'^){y) •= for A G Rj^, u G S{R^^H), extends to a group 

action on W^(R^,H), and we have 

(1.61) W"(RP, W"(E^ H)) = H), 

where the space on the left of relation (1.61) refers to {xa}a€M+ on 
W^{R^^H) and that on the right of (1.61) to {ka}a6M+ on H. 

(iv) For H := H^{R^) with the group action {K\u){y) := X^^^u{Xy) we have 

W%RP,H^{R^)) = H^{RP^^). 

Let us set for any open C 5 G M, 

(1.62) {u G V'{Q,H) : pu G W%R^,H) 

for every p G (O) } 

and 

(1.63) VVcomp(^> H) ■- {m G Wioc(^^> H) : suppw compact}. 

The space (1.62) is Frechet, and (1,63) is an inductive limit of Prechet spaces. 

In particular, we have 

(1.64) X R) = WL(0,if*(R)),ff,^„„p(^)(n X R) = H%R)) 

for any open set O C £is well as 

(1.65) 

X R±) = lVf,,(f2,/f^(R±)),/f,^,^p(^)(n X R±) = W^,^^{U,H%R±)). 

Theorem 1.54. Let a{y,y',rj) G S>^{Cl x ft x R9;H,.tf), 0 C R« open, peR, 
with H and H being Hilbert spaces with group actions. Then 

Op(a)u(y) ■= jj e'-^y~y'^'^a{y,y',y)u{y')dy'dp 

induces a continuous operator 

Op(a) : CS°(n, H) C°°(fi, H) 
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which extends to continuous operators 

Op(a) : ^ Wi;7(o,5) 

for all s G M. /n particular, for a{rj) G H, H) we obtain continuous opera- 
tors _ 

Op(a) : 

for all s G R. 

Remark 1.55. The notation (1.62) and (1.63) as well as the results of Theo- 
rems 1.53, 1.54 extend in a natural way to the case of Prechet spaces H or H with 
group actions. 

Theorem 1.56. Let a{y,t,r],r) G *S'^i(0 x E+)tr be a symbol which is inde- 
pendent of t for t > c for some c > 0. Then Op^(a) := r“^ Op(a)e”^ (for any 
d G X E)tr with a — a for t >0) induces continuous operators 

Op+(a) : ®+) ^ ^ R+) 

for all s eR, s > 

This result is a consequence of Theorem 1.51 (i), the relations (1.65), and 
Theorem 1.54. 

Let X be a compact manifold with boundary T, and let 2X denote the 
double of X, obtained by gluing together two copies X+ and X- of X along their 
common boundary Y by the identity map; we then identify X with X+. Moreover, 
let e^ denote the operator of extension of functions on intX_^ by zero to the 
opposite side X_, and let r+ denote the operator of restriction of distributions 
on 2X to intX-^; analogously, we have operators e~ and r“ with respect to the 
minus-side of 2X. Let 2X be equipped with a Riemannian metric that equals the 
product metric of Y x (-1,4-1) in a neighbourhood of Y for some Riemannian 
metric on T. _ _ 

Given an G Vect(X) we fix any E G Vect(2X) such that E = E\x’ For 
E and F in Vect(X) with fibre dimensions I and k, respectively, we now consider 
the space L^^(2X; F). For every chart y : F ^ ^ on 2X, U C R'^ open, and 

trivialisations E\y ^ U xC\ F\y = U xC^, the push- forward y+A of an operator 
A G L^|(2X;F,F) belongs to C^). By notation, the push- forward y=, 

also takes into account the chosen trivialisations of F|y and F\y] for simplicity 
they are not explicity indicated (this should not cause confusion). 

Let V nY ^0, V := V' x (— 1,+1), where V' is a coordinate neighbourhood 
on the boundary Y, and assume that y restricts to charts y± : F± x R± on 
X±, V± := X± n V, and to a chart y' x\v' : F' — > O on T, O C 

Definition 1.57. The space L^j(2X;F;F)tr for /x G Z is defined to be the 
set of all elements A G L'^^{2X', E, F) such that for every ^ x E) and 

:= 
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is an A: X / matrix of elements in x M)tr; here, x is an arbitrary chart of the 

described kind. 

Moreover, set 

(1.66) L^^{X- E, := {r+Ie+ : A G L^,(2X; E, F),,}. 

Remark 1.58. L^j(2X;£', F)tr is a closed subspace of L^^{2X]E,F)^ cf. Re- 
mark 1.2. Moreover, the space 

(1.67) {A G i^i(2X; E, F)u : r+Ie+ = 0} 
is closed in L^^(2X; F)tr, and we have 

(1.68) L^JX; E, F),, = L^,{2X; E, F)/ 

where / ^ indicates the quotient space with respect to (1.67). In this way, in the 
space L^j(X; F)tr we obtain a natural Frechet topology. 

Theorem 1.59. Every A e L^^{X;E,F)tr induces continuous operators 

A: H%X,E) H^-^{X,F) 

for all s s > — 1 . 

Proof. Let c<;,a; be functions supported in a collar neighbourhood of Y such 
that a; = 1 on suppo?. Then A can be written as A = uAuj -h (1 — lu)A{ 1 — 
uj) + C, where C has a smooth kernel up to the boundary. The continuity C : 
H^{X,E) C°^{X,F) for s > —1 is then evident, while the continuity of (1 — 

(jj)A{\ — uj) : H^{X,E) H^~^{X,F) for all s is a consequence of Theorem 1.4 

(i). The continuity of ujAuj : H^{X,E) H^~^{X^F) for s > — 1 follows from 

Theorem 1.56 by a simple partition of unity argument and from Theorems 1.53, 
1.54. □ 

Let us look at a special kind of order reducing symbols. Choose a function 
(p 6 <5(M) such that (p(0) = 1 and suppF~^(^ C M_ (here F is the Fouier transform 
on the real line). Set 

(1.69) (‘^(c^) 

for any /a e R and a constant C > 0. We then have rf{r],T) e S'^j(M”), and the 
symbol r^{rj^r) is elliptic for a sufficiently large C > 0, cf. Grubb [ 16 ]. It is well 
known that 

(1.70) r+ Op(r^i)e+ : H^{Rl) H^-f^{RD 

is continuous for every s,/i G M, with e+ : being a continuous 

extension operator, i.e., r+ej“ = Moreover, for s > — | we may replace e+ 

by e“^, and (1.70) is independent of the choice of the specific extension operator. 
For /i G Z we have r^{rj,r) G 5^j(E’^)tr- Order reducing operators also may be 
formulated globally on a compact manifold X with boundary. 
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Theorem 1.60. The space E, E)tr for E G Vect(X) and arbitrary fi G 

Z contains an element := for some G L^^{2X; E^ E)tj., E = E\x, 

such that 

R% : H^{X,E) H^-^{X,F) 

is an isomorphism for every 5 > — ^ . 

This result can be proved in different ways, cf. Boutet de Monvel [7], or Grubb 
[16]; the latter paper employs order reducing symbols of the kind (1.69). Such 
symbols for arbitrary /x G M have been used for an analogous order reducing result 
for the case without the transmission property in the author’s joint paper with 
Harutjunjan [20]. Other constructions in this direction (more general in different 
ways) may be found in Duduchava and Speck [10] . A completely different method 
to reduce orders in general boundary value problems is given in [43], based on 
ideas of the edge pseudo-differential calculus. 

Remark 1.61. The operators in [20] are obtained in a slightly more general 
form, namely as r+R~e+ for operators G I/^^(M; E, E) on any closed compact 
(7^ manifold M which contains X =: and X_ M \ int as submanifolds 

with common boundary T, with an evident generalisation of the meaning of op- 
erators r"^, e+ (and r~,e~ with respect to the minus side). We can also construct 
an operator 5~ of similar meaning for X - , such that 

r-S^e- : ^ H^-^{X.,E\xJ 

are isomorphisms for s >-i The local symbols of *9- in a collar neighbourhood 
of Y are just r+{y,v) := r^(y,77), the complex conjugate of (1.69). 

Given an operator A G L^^{X]E, F)tr, A := r”^Ae+ for an A G L(f^(2X; E^ T)tr, 
cf. the formula (1.66), we have the homogeneous principal symbol cr^{A) : > 

t^ 2 xF^ cf. (1.5), and we set a^{A) := o-^{A)\t*x\o^ 

(1.71) a^{A):7r^xE^7T^xF, 

7Tx • T*X \ 0 ^ X. With (1.71) we associate a family of operators 

(1.72) ad{A){y,T)) := r+a^{A){y,0,r},Dt)e+ 

■- r+op(cr^(A)|t=o)(2/,??)e'^ 

for {y,r}) G T*Y \ 0. This gives us a bundle morphism 
ao{A) : tt^E' (g) R"(E+) ^ tt^F' (g) 

for every fixed s G M, s > — |, Try : T*T \ 0 T, where E' := £^|y, F' := F|y. 
Alternatively, we consider ao(A) as a family of maps 

(1.73) ad{A) : tt^E' (g) 5(S+) ^ tt^F' (g) <S(I+), 
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<S(M+) We call a^{A) the principal interior symbol, <J^(v4) the prin- 

cipal boundary symbol of the operator A. 

Remark 1.62. For := X^u{\t), X c M_|_, we have 

(1.74) (^d{A){y, Atj) = \^^Kx<7g{A){y, ri)K^^ 

for all A G M 4 -. 

We now pass to the algebra of boundary value problems on X with trace 
and potential conditions, cf. [7]. First, for E,F e Vect(X), J_, Jy G VectCF), 
V := {E, F; J_, J_^), by v) we denote the space of all 

. . C^{X,E) C^{X,F) 

^ •= (t n) • ® ^ ® 

such that Q and G* extend to continuous operators 

H^{X,E) C^{X,F) H^{X,F) C^{X,E) 

0 : 0 ^ 0,5*: 0 ^ 0 

for all s G M, s > — |. Here 5* is the formal adjoint of G in the sense 

(1-75) 5*n)L2(x,£;)eL2(y,j_) = (5^, n)L 2 (x,F) 0 L 2 (y,j+) 

for all u G C^{X,E) 0 C^{Y,J-)^ ^ ^ C^{X,F) 0 C^{Y,JX'^ the - scalar 
products refer to the chosen Riemannian metrics on X and Y and to the Hermitian 
metrics in the respective vector bundles. 

For every vector bundle E G Vect(X) we fix a first order differential operator 
T : E) C^(X, E) that is equal to dt<S>idE in a collar neighbourhood of 

the boundary, with t being the normal variable. Then B~°°’^{X;v) for d G N\ {0} 
is defined to be the space of all operators 

d 

(1.76) g = go + J2^jding{T\0) 

for arbitrary Gj G v). The elements of v) are called smoothing 

operators of type d. 

We now turn to Green symbols that are operator- valued symbols in the sense 
of Definition 1.50 (iii) for Hilbert spaces 

JT = 0 C^-, H = 0 

or Schwartz subspaces, where k,\ as well as are defined by u 0 c ^ A 2 u(At) 0 c, 
A G E+, for a vector- valued function u(t) and a vector c of complex numbers. 

Definition 1.63. Let G N, /x g M, and D C open. An element 

g{y, rj) G x L^{R+X^) 0 , L\R^X^) 0 
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is called a Green symbol of order and type 0, if it has the properties 
g{y,r]) € x R«; L2(R+, C') © ,<S(1+, C'=) © C^+) 

and 

g*{y,v) € X R«;L2(R+,C'=) ©C^+,5(1+,C') ©C^-), 
where g*{y,rj) denotes the pointwise adjoint in the sense 

('^^9 ( 2/5 ^)'^)l 2 (m+,o©c^- ~ ^)l 2 (m^,c'^)©c^+ 

for all u e L2(M+,C0 0 O-, ^ G L2(M+, C^) 0 0+. Let x w = 

(l^k; denote the space of all such symbols. 

Remark 1.64. It can be proved that every g{y,rj) G 71q^{Q. xW;w) induces 
elements 

g{y,g)e S^^{n x iL"(E+, C^) 0 C^ - , <S(1+, C^) 0 C^+) 
for all 5 G E, 5 > — |. 

This is a consequence of a kernel characterisation of [37, Theorem 3.1], cf. also 
[39, Section 4.2.3]. 

Note that the differential operator df on E+ represents an operator- valued 
symbol 

d{ G X E'3;/f"(E+,C^),i7"-^(E+,d)) 

for every s G E; there is in this case no dependence on {y^g) G x E^. 

Definition 1.65. By 1Zq^{Q. x E^; it;) for /i g E, d g N, we denote the space 
of all operator functions 

d 

giy^fl) ■= 9o{y,r]) + '^gj{y,r])dia.g(di,0), 

J=1 

for arbitrary gj{y,g) G x E"^,ii;). The elements of 1Zq^{Q. x E^;ii;) are 

called Green symbols of order /i and type d. 

Notice that g{y,g) G 1Zq^{Q. x R.^;w) implies 
(1.78) g{y,g) G x E^;77^(E+,C0 0C^'-,<S(E+,C^) 0C^+) 
for every 5GE, 5>d— 

The nature of Green symbols as operator- valued symbols in the sense of Defi- 
nition 1.63 has been first observed in [37, Theorem 3.1]. A similar characterisation 
holds for Green operators belonging to boundary value problems without the trans- 
mission property, see [38]. In this case, the space <S(E+) is to be replaced by a 
space of functions with more general conormal asymptotics rather than Taylor 
asymptotics at t = 0 (and Schwartz function behaviour for t — ^ 00). 
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Theorem 1,66. For every g{y,r]) C 1Zq^{Q. x w = {l,k]j-,j-^), the 

associated {so called Green operator) Q := Op{g) induces continuous operators 

(1.79) g : X K+>C') 0 

- K~ciy)i^ X R+,&) © F,;7(n, ) 

for all s eR, s > d — 

Proof. We have 

g{y,g) G S^^{Q x R^;i/^(R+,d) 0C^-,i^"-^(E+,C^) 0C^+) 

(which is more crude than (1.78) but sufficient for the moment), and then 

S • W,",^p(Q,i^"(]R+,C') 0C^-) ^ Wi;7(0,i7^-^(M+,C^) 0C^+) 

is continuous for s > d — cf. Theorem 1.54 (the W^-spaces refer to the same 
group actions as in Definition 1.63.) Now we have 

>V,Up(0,i7^(R+,C') 0C^-) = xR+,C') 

and, similarly, with subscripts ‘loc’, cf. Theorem 1.53 (iv). □ 

By definition, the symbol g{y,rj) has a homogeneous principal component 
9{^){y^'n) order /i, cf. Definition 1,50 (iii). It will be interpreted as the boundary 
symbol 

(1.80) (Ta(g)(j/,?7) :7f^(R+,C')©C^'- ^ 5(1+,C*) © C^+ 

of the associated pseudo-differential operator Q — Op( 5 '). Alternatively, we also 
write 

(1.81) cra(g)(j/,r/) :5(1+,C')©C^- ^ <S(1+,C^) © C^+. 

Now let E,F E Vect(X) and J_, J+ G Vect(y), and consider trivialisations 

(1.82) E\v = xC\ F\v ^nxR_^ 

(1.83) J±|v^DxC^± 

on a coordinate neighbourhood T on A near the boundary F, such that F' ;= 
y n F 7 ^ 0, and let x • ^ ^ x R-\- and y' : F' be corresponding charts on 

X and F, respectively. 

Green operators (1.79), interpreted for a moment as operators 

g : c^(fi X l+,c') © c^(f2,c^'-) ^ c°°{n X l+,c'^) ©c°°(n,c^+) 

can be pulled back to X with respect to the mapping (1.82), (1.83) as operators 

Gv : Co^(F, E\y) 0 Co^(F', ^ C^{V, F\y) 0 C^(F', 

Let us write, for simplicity, Gv = C)p(^); the pull back also refers to the 

cocycles of transition maps of the involved bundles. Let us now fix a finite system 
^ of such coordinate neighbourhoods on X near F such that 
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form an open covering of Y, and choose functions 6 j = 1, . . . , L 

such that J2j=i = 1 in a collar neighbourhood of Y and 'ipj = 1 on supp (pj for 
all j, and set (/?' := Pj\v', ‘= 

Definition 1.67. (i) The space for v := (E", F; J_, J+), 

/i G Z, d E N, is defined to be the set of all operators 

L 

Q := ^diag(<^j,(/jj)(xJ^)* Op((/j) diag(V>j, + C 

for arbitrary and C E and gj{y,r]) E 1Zq^{VL x 

l<j<L. 

The elements of Bq^{X\v) are called Green operators on X of order 
(JL and type d. The families of maps (1.80) or (1.81), applied to localisa- 
tions of Green operators ^ in a coordinate neighbourhood V, have an 
invariant meaning as bundle morphisms 

/E' 0 F"(M+)\ (F' 0 i/"-^(M+)\ 

(1.84) CFd{Q) -TTyl © j^TTyf 0 j, 

7Ty :T*y\0— >y,s>d— (alternatively, we may write <S(My) instead 
of on the right hand side, or <S(M+) on both sides). 

(ii) The space B^'^{X; t?), /i E Z, d E N, is defined as the set of all operators 

(1.85) .4=(^ S)+e 

for arbitrary A E L^^(X; F, F)tr and Q E Bq^{X\v). The elements of 
B^^^{X;v) are called (pseudo-differential) boundary value problems for 
the operator A, of order p and type d. 

(iii) We set a^(^) := a^{A)^ called the (homogeneous principal) interior 
symbol of A of order p, and 

called the (homogeneous principal) boundary symbol of A. Set 

( 1 . 86 ) a{A) := {a^{A),ad{A)), 

called the principal symbol of the operator A. 

The homogeneity of a^{A) is as usual, i.e., (j^{A){x, X^) — X^(j^{A){xA) for 
all A E My, {xA) ^ T*X \ 0. For ad{A) we have 

(1.87) a 9 {A){y, Xi]) = diag(«.A, id)o-a(.4)(y, t]) diag(y \ id) 
for all A G K+, (y,r?) € T*y \0. 
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By 

(1.88) B^’'^{X-,E,F) and £■, F) 

we denote the space of upper left comes of 2 x 2 block matrices in Bq^{X\v) 
and B^’‘^{X;v), respectively. Given an element A E B>^’'^{X\v) in the form A = 
{Aij)i^j^i^ 2 i we also set An \= ulc A. The operator A 21 is often called a trace and 
A \2 a potential operator in v). Note that A 22 belongs to J_, J+). 

Remark 1.68. The following conditions are equivalent: 

(i) G e B^^^{X]E,F) and (fG'ijj G L-^{mtX-E,F) for every G 
Co^(intX), 

(ii) G e B^'‘‘{X;E,F). 

Remark 1.69. Every G E Bq‘^{X- E,F) has a unique representation 

d-l 

(1.89) G = Go + 

j=0 

for a Go G Bq^{X;E,F) and potential operators Kj G F; E' ,0) 

and TjU = r'T-^, cf. the notation of (1.76). 

Theorem 1.70. Let X be a compact G^ manifold with boundary Y. 

(i) Every A G B^^^{X\v) for v := {E,F; J_, J+) induces continuous oper- 
ators 

H^{X,E) 

(1.90) ^ : 0 0 

7f"(y,J_) i7"-^(F,J+) 

for all s s > d — \ . 

(ii) A G B^^^{X;v) and cr{A) = 0 imply A G B^~^'^{X\v), and hence the 
operator (1.90) is compact. 

(hi) A G B^^^{X;v) for v := {Eo,F;Jq,J^) and B G B^^%X;w) for 
w := {E^ Eq; J-, Jo) implies AB G o w) for v o w 

{E, F] J_, J+) and h = max(u Y d,e), and we have 

a{AB) = (j{A)a{B) 

{with componentwise multiplication). 

(iv) The formal adjoint A* {cf. formula (1.75)) of an operator A G B^'^{X\v) 
forv := (E,F;J_,J+) belongs to B^^^{X;v^) for := (F,F;J+,J_), 
and we have 

a{A*) = a{A)* 

{with componentwise adjoint, cf. formulas (1.10) and (1.77)). 
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Theorem 1.71. Let v := (E", F; J_, J+) for vector bundles E,F e Vect(X), 
J_, G Vect(T), and let Aj 6 j G N, be an arbitrary sequence. 

Then there exists an element A G such that 

N 

j=0 

for every N £N, and A is unique mod B~^'^{X\v). 

1.3. SL-elliptic boundary value problems. 

Definition 1.72. Let A G /x G Z, d G N, ?; := (F, F; J_, J+) for 

F, F G Vect(X), J_, J+ G Vect(F). 

(i) The operator A is said to be SL-elliptic (of order yi) , if both 

(1.91) a^{A):iT^xE^iT^xF. 

Tlx : T*X \ 0 ^ X, and 

/F'^<S(l+)\ /F'(8)5(l+) 

(1.92) (Td{A) : 7Ty f 0 1 TTy I 0 

71 Y : T*y \ 0 — ^ y , are isomorphisms. 

(ii) An operator V G B~^'^{X;v~^) for some e G N, v~^ := {F, E; J-), 
is called a parametrix of A, if V satisfies the following relations: 

(1.93) Ci:=I-VAeB-°^''^‘{X;vi), Cr ■■= I - AT € 

for certain di,dr G N, vi := {E, E; J-, J-), Vr := {F, F; J^, where 
X denotes the corresponding identity operator. 

Remark 1.73. If (1.91) is an isomorphism, a bundle morphism (1.92) for 
A G B^'^{X\v) is an isomorphism, if and only if 



/F' 0 F"(M+)\ /F' 0 F"-^(R+) 

(1.94) CFd{A) : TTy f 0 I ® 

is an isomorphism for any fixed 5 = sq G M, sq > max(^, d) — ^ (or, equivalently, 
for all s > max(/i, d) — |). 

Remark 1.74. If A G L^j(X;F, F)tr is elliptic, i.e., (1.91) an isomorphism, 
we have 

(1.95) F' ^ F'. 

In fact, let us consider the composition Aq := cf. Theorem 1.60. Then we 

have Aq G F^’°(X; F, F), and cr^(Ao) : tt^F tt^F also is an isomorphism. Let 
S := 5*X|y U N with the conormal interval {(y, (^ 7 , r)) : 77 = 0, — 1 < r < 01}. 
The transmission property of symbols of order zero has the consequence that 
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<7^{Ao)\s^xw:7t*^E' 

for 7T2 : S'*X|y ^ Y extends to an isomorphism n^E' 7t|F, where : E Y 
is the canonical projection of S := S*X\y U N to Y. 

Since F C H, the latter isomorphism then restricts to an isomorphism (1.95). 

Theorem 1.75. Let A e v), /j. e Z, d eN, v := {E,F; J_, J+). 

(i) The operator A is SL-elliptic {of order p), if and only if (1.90) is a 
Fredholm operator for an s = sq sq > max(/i, d) — 

(ii) If A is elliptic, (1.90) is a Fredholm operator for all s > max(//,d) — 
and dimker^ and dim coker ^ are independent of s. 

(hi) An elliptic operator A has a parametrixV 6 {X;v~^) {p~^ := 

max(p,0) for any p G R) which can he chosen in such a way that the 
remainders in the relation (1.93) are projections 

Cl : H^{X,E)eH^{Y,J.)-^V, 

Cr : H^-^{X,F)^H^-^{Y,Jy) 

for all s > max(/i,d) — ^ and are of type di = max(p,d) and dr = 
{d — p)+, respectively, for V := ker^ C C^{X,E) 0 C^{Y\ J-), and 
some finite- dimensional sub space W C C^{X,F) 0 (7^(1^; J-i_) such 
that 

IT + im^ = H^-^{X, F) 0 H^-^{Y; J+) 
and IT n im^ — {0} for every s > max(/x, d) — 

An operator A G B^'^{X; E, E) will be called cr^-elliptic (of order p), if (1-91) 
is an isomorphism. 

Remark 1.76. Let A g B^A(^X\E,F) be cr-^-elliptic. Then 

(1.96) (Td{A){y,ri) : E'^ 0 H^{Ry) ^ F> H^~^{Ry) 

is a family of Fredholm operators for all s > max(/i, d) — and ker cra(A)(y, p), 
cdkev (Jd{A){y,r]) are independent of 5. For every G G Bq^{X;E,F) we have 
ind(Ja(A)(y, rj) — indcra(A 0 G){y, rj) for all {y, p) G T*Y \ 0. Moreover, by virtue 
of the homogeneity (1.87) it follows that indad{A){y,p) = mdad{A){y,p/\p\). 

Thus it makes sense to interpret (1.96) as a family of Fredholm operators, 
parametrised by {y,p) G 5*T, the unit cosphere bundle. As such there is an index 
element 

(1.97) mds*yCTe{A)eK{S*Y), 
cf. Atiyah and Bott [3], Boutet de Monvel [7]. 

Remark 1.77. Let A G R^’^(A;v) be SL-elliptic. Then, in the notation of 
Definition 1.72 for A := ulc A we have 

(1.98) ind5*y cra(A) - K J+] - [tti* J_], 




ELLIPTICITY WITH GLOBAL PROJECTION CONDITIONS 



385 



where tti : ^ F is the canonical projection. In other words, SL-ellipticity of 

A entails the relation 

(1.99) ind 5 *y aa(A) G 7r*K(Y), 



2. Ellipticity with global projection conditions 

2.1. The index obstruction. We first discuss the problem, whether a a^- 
elliptic operator A e E, F) admits SL-elliptic boundary conditions. 

Theorem 2.1. Let A e E, F) be a^-elliptic. Then the following con- 

ditions are equivalent: 

(i) There is an SL-elliptic element A G B^'^{X\v), v {E, F; J_, J+) for 
certain J± G Vect(Y') such that A = ulc A. 

(ii) A satisfies the relation (1.99). 

Remark 1.77 shows that (1.99) is necessary for the existence of an SL-elliptic 
operator A with A as upper left corner. For the converse direction we first establish 
a result on general families of Fredholm operators. 

In the following consideration we assume M to be a compact topological space. 
In this connection by Vect(M) we understand the set of complex vector bundles on 
M in the continuous category, i.e., with continuous transition maps between local 
trivialisations. Moreover, let Hi and H 2 be separable infinite-dimensional Hilbert 
spaces. For every function 



aeC{M,C{Hi,H2)) 

with values in the set T{Hi,H 2 ) of Fredholm operators between H\,H 2 there is 
an index element 

(2.1) m&M CL ^ E{M). 

The construction is based on the following observation. There exists a finite- 
dimensional vector space and an injective linear map k : W ^ H 2 such that 

Hi 

(2.2) (a(m) k) : 0 H 2 

W 

is surjective for all m G M. Then (2.2) is again a continuous family of Fredholm 
operators, now surjective. Hence the family of kernels {ker(a(m) k) : m £ M} 
represents a finite-dimensional subbundle V of M x (iLi 0 W). In other words, 
there is a F G Vect(M) and a continuous family of isomorphisms 

(2.3) Vm : ker(a(m) k) Vm 

(with Vm being the fibre of V over m). Let Pm ’ Hi ^ W ^ ker (a(m) k) denote 
the orthogonal projection and set (t(m) g{m)) Vm ^ Pm- 
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Then 



a{m) k 
t{m) g{m) 



Hi H2 

© ^ © 



is a continuous family of isomorphisms, and we define 



(2.4) indM a - [H"] ^ K(M), 

where W is identified with the trivial bundle M x ^ . 



Remark 2.2. Let a e C(M, i/ 2 )) be as before, and let V,W e Vect(M) 
such that there is a continuous family of isomorphisms 



( a(m) k{m) 
t{m) g{m) 



Hi H2 
© ^ © , 
Wm Vm 



m e M 



for suitable operator functions k, t and g. Then we have 

indM a = [V] - [W]. 

In other words, the element indM o, is independent of the choice of the bundles 
V, W and of the operator families k,t,q. 

Remark 2.3. Let c e C{M, C{Hi,H2)) be a family such that c{m) is a com- 
pact operator for every m e M. Then we have 

indM(o^ c) — indM ci. 



For purposes below we need the following more specific construction. 



Proposition 2.4. Let a e C{M,T{Hi, H2)) be a Fredholm function, and let 
L± G Vect(M) be a fixed choice of vector bundles such that indM o> = [T+] — [L-]. 
Then there exists an element c G C{M, C{Hi, H2)) with values in operators of 
finite rank such that a := a c has the following properties: 



(i) kera = L-t_, coker a ^ L-, i.e., there are subbundles L+ C M x Hi, 

= L4. and L_ C M x H2, L- = L-, such that L^^rn — kera(m), 
L-^m + im a(m) — H2, and L-^m + im a(m) = {0} for all m ^ M 

(ii) There are (continuous) bundle morphisms 

(2.5) k:L.^MxH2, t : M x Hi ^ L+ 

such that 



(2.6) 



a k 
t 0 



Hi H2 
© ^ © 
L_ L+ 



is an isomorphism. 
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Proof. As before we first pass to the surjective family (2.2). By assumption, 
we have 

mdMa^[V]-[W] = [L+]-[L.] 

in K{M). We can choose dimW as large as we want, and we now replace W by 
W 0 W\ for another finite-dimensional Wi, and together with k we choose a 
ki : Wi ^ H 2 ^ and such that k^ \= diag(/c, ki) \ W ®Wi ^ H 2 is injective. Let 
p : H 2 vaik^ denote the orthogonal projection, and write oP (1 — p)a. Then, 
for := W 0 W\ the operator family 

Hi 

{a^ k^): 0 -^^2 

is surjective, and := kerM cl^ is a subbundle of H\ isomorphic to a bundle 
G Vect(M) where = P 0 Wi (here vector spaces F are identified with the 
respective trivial bundles M x F). By the formula (2.4) applied to a® we obtain 

(2.7) indM a" = [P"] - = [L+] - [L_] 

for := P 0 IP 1 . We may assume that the given bundles L± are both subbundles 
of the trivial bundle Wi for a sufficienty large choice of dim Wi . 

There are then complementary bundles of L± in P^ and , respectively, 
i.e., we have 

L+0L:[: = P^ 

Then the relation (2.7) implies [Lij:] = [Lp] in K{M), i.e., there is an R such 
that Z/|: 0 = Li 0 C^. Replacing Wi by Wi 0 in the construction before 

and returning to the former notation, we thus obtain = Li. By construction 
there are subbundles L_,Li c H 2 such that L_ = L_, Li = Li wich L_ 0 
Li = imk^, and subbundles L_t_, L:J: C Hi such that L_(_ ^ L+, Li{: = Lij: and 
0 Lij: = kera^. Choose any isomorphism A : Lij: ^ Li, and let tt-^ : Hi ^ Lij: 
denote the orthogonal projection, : Li — > H2 the canonical embedding. Then 
g ;= r*- o A o 7T-*- : LTi ^ H 2 is a continuous family of operators of finite rank, and 
q satisfies the relations 

kerM(«^ q) = L^, coker m{cP 0 g) = L_. 

Because of = (1 — p)a we may set a := a0c for c --pa-\-q. Then a satisfies the 
relations of Proposition 2.4 (i). To construct the isomorphism (2.6) it suffices to 
choose isomorphisms /i : L_ ^ L_ and Z : L+ — ^ L+, and to set k := ih, t In, 
where l : L_ ^ H 2 is the canonical embedding, n : Hi ^ L+ the orthogonal 
projection. □ 

Remark 2.5. Let A e E, F) be cr^-elliptic, and consider the Fred- 

holm operators (1.96) for any fixed s > max(ju, d) — Then there is a subbundle 
W C 7t*F' 0 tS(M^) of finite fibre dimension such that 

0 imao{A){y,p) = F' 0 F^-^(E+) 
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for all {y, rj) G S*Y, 

Choose a vector bundle W G Vect(5*y), and let 

k:W -^W 

be an isomorphism. Then 

(2.8) iae{A){y,v) %,r?)) : © ^ 

V Wy,, j 

is a surjective family of Fredholm operators. W can be chosen as the pull-back of 
a bundle on Y with respect to tti : S*Y -a- Y (in fact, we may assume that it is 
trivial). 

Let __ 

piTTlF' 

be a projection (orthogonal with respect to the Fy (g) L^(R_^) - scalar product in 
the fibres). Then 

(1 - p)a3{A) : ttIE' ^ H^{R^) 7t*F' 0 H^~^{R^) 

is again a Fredholm family such that 

V := ker^^y (1 - p)(Jd{A) C n^E' (g) 5(1+) 

is a subbundle, and 

inds.y(l -p)aa{A) = [V] - [W] 
for any V € Vect(5*F) which is isomorphic to V. 

Proposition 2.6. Let A e B^'’^{X\E,F) be a^-elliptic, andL± € Vect(S'*y) 
such that 

(2.9) ind5.y<T9(A) = [L+]-[L_]. 

Then there exists an element G G E^ F) such that 

(2.10) keTs*Y{cT9{A + G)) ^ L+, coker5*y(aa(^ + G)) ^ L_. 

Proof. The construction of G may be given along the lines of Proposition 

2.4 (i). Let us fix some s G M such that s > max(/i, d) — ^ (the specific choice of s 
will be unessential), and let 

a : 7 t*F;' 0 F"(E+) n^F' 0 H^~^{R^) 

for 7Ti : S*Y ^ Y denote the restriction of ad{A) to S*Y. According to Remark 

2.5 there is a surjective bundle morphism 

/7Ti*F;'0iJ^(R+)\ 

(a A:): 0 ^ 7 t*F' 0 if ^(E+) 

\ w J 

for a VF G Vect(5*T), where k : W W is a.n isomorphism to some subbundle 
W of ttiF' 0 5(M+). Without loss of generality, we assume W to be trivial. Let 
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p : 7 t*F' (8) — > VF be a projection that is orthogonal in the fibres with 

respect to the scalar products of Fy (8) L^(R+). By adding, if necessary, another 
finite-dimensional subbundle to W (and denoting the new bundle again by we 
obtain the following properties: There are subbundles L- CW and 

L+CV := ker 5 *y((l - p)a) C ttIE' (8) 

such that L_ = L_, = L_(_. In addition, choosing complements in W and 

Lij: in y, we have provided the fibre dimension of W is sufficiently large. 

If A : L:{: ^ Li is an isomorphism, and if 

7T*F'(8)i7"“^(IR+) 

is the canonical embedding, and 

the orthogonal projection, the operator family ao := (1 — p)a-h^ for g 
has the property 

(2.11) L+ = ker^^y ao, L- = coker^^y uq. 

The operator function g := —pa + g : 7 t*L^' 0 i7®(M+) — > 7 t*F' (8) can be 

extended by homogeneity to a morphism 

: tt^E' (8) Lr"(My) ^ tt^F' 0 i7"-^(R+), 

i-e-,fif(f,)(?/,A»?) = for all A e K+, {y,t]) € T*y\0, and Sf(^)|s*y = 

g. Now we may set 

L 

(2.12) G :=Y^(pj{x~^)^Op{gj)ipj, 

J = 1 

cf. Definition 1.67, where gj{y,p) are local Green symbols of order fi which have 
^ homogeneous principal components (in local coordinates it suffices 
to set gj{y,g) := x{v)9(iJ,){y^p) for ^riy excision function x(^))- Because of ao = 
CTd{A F G)\s*y^ fho assertion follows from the relations (2.11). □ 

Theorem 2.7. Let A C E^ F) be a a^-elliptic operator. Then there 

exist vector bundles 

J± e Vect(T) and L± e Vect(r*T \ 0) 

and an operator A € for v := (L, F; J_, J+) such that (1.94) restricts 

to an isomorphism 

tt^E' 0 H^{R+) tt^F' 0 LT^-^(E+) 
0^0. 

L_ L+ 



(2.13) 
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Proof. If ^ C E, F) is -elliptic, the boundary symbol (Jd{A) rep- 

resents a family of Fredholm operators (1.96), and there is an index element (1.97). 
Choose any L± G Yect (S*Y) such that 

ind^^y o-a(yl) = [Ly] - [L_]. 



For abbreviation, L± will also denote the pull-backs of these bundles to T*Y \0 
under the canonical projection T*P \ 0 — > S*Y. Applying Proposition 2.6 we find 
a Green operator G G Bq^{X;E,F) such that the relations (2.10) hold. 

Choose arbitrary bundle morphisms 

ki : L- ^ 7t*F' (8) iS(]R+), ti : ttIE' (8) iS(M+) ^ Ly, 



such that ki represents an isomorphism L- L_, and ti restricts to an isomor- 
phism Ly ^ Ly, cf. the notation in the proof of Proposition 2.6. Then the block 
matrix 



(2.14) 



Cd{A + G) ki 

ti 0 



7T*F;' (8) i7"(Ry) ttIF' (8) if"-^(Ey) 
0 ^ © 

L_ Ly 



is an isomorphism for every s > max(/x, d) — Now let J± G Vect(T) be arbitrary 
bundles such that L± are subbundles of tt^ J± (for J± we may always take trivial 
bundles of sufficiently large fibre dimension). We then obtain a bundle morphism 



(2.15) 



ad{A G) ko 

to 0 



7T*F;' (8) if"(Ry) 7T*F' 0 ilP-^(Ey) 
0-^0 
7T*J_ 7T*Jy 



when we set ko ki o7t_ for a bundle projection 7 t_ : tt* J_ ^ L_ and to := L^oti 
for the canonical embedding : Ly ^ tt* Jy. By construction, (2.15) restricts to 
the isomorphism (2.14). Next we extend (2.15) by k a - homogeneity /i to a boundary 
symbol of the form (1.94), which has the form 



/ad{A-\-G) 

V ^ / 

for unique k(^^){y,r]) and satisfying k(^^){y,y/\r]\) = ki{y,r]/\r]\) and 

^(/i)(y? '^/I^D = ti{y^T]/\r]\)^ respectively. Similarly to the construction of (2.12) we 
find potential and trace operators K and T, respectively, such that (Jd{K) — 
^d{T) — 

Setting 



(2.16) 



A = 



A + G K 
T 0 



we obtain an element in B^^^{X;v) as desired. 



□ 



Remark 2.8. For ind^^y cfq{A) G 7TiK{Y) we can carry out the construction 
in the latter proof with bundles tt* Jy for suitable J± G Vect(y) in place of L±. 
Then (2.13) shows that the operator (2.16) is SL-elliptic. 




ELLIPTICITY WITH GLOBAL PROJECTION CONDITIONS 



391 



Proof of Theorem 2.1, (ii) =4- (i). If the relation (1.99) is satisfied, the 
family of Fredholm operators (1.96) for any fixed s > max(//, d) — | can be com- 
pleted to a block matrix (1.94) that is an isomorphism. For the construction we 
first restrict cTd{A) to (denote it again by ad{A)) and set J_ 0~. For a 
sufficiently large j_ there is an injective bundle morphism 

ko :7T*J_ ^ nlF' ^S{W+) 

such that 

nlE' 

{aa{A) ko): 0 tt^F' 0 Ff^-^(M+) 

7TiV_ 

is surjective. Then ker^^y (<ja(A) Aiq) is a finite-dimensional subbundle of 

ttIE' (g) <S(My) 

(2.17) 0 

7Ti*J_ 

As we saw by the above constructions, for a sufficiently large choice of j- the 
bundle ker 5 '*y(o'a(A) ko) is isomorphic to for some J+ G Vect(5'*T). 

Now let 

Ko : ker5*y(o-a(A) ko) -> tt* J+ 
be any isomorphism, and let 

<F;'(g)Jd"(R+) 

(2.18) 7To : 0 kersey ((Ta( A) ko) 

7Ti*J- 

be the orthogonal projection with respect to the {Ey 0 L^(IR+)) 0 J_^^-scalar 
products in the fibres, first for s > max(/u, d) and then extended by continuity to 
all 5 > max(/i, d) — 

Setting (to qo) ■= o ttq we obtain an isomorphism 



(T I )-’.•( I 

There is then a unique extension to an isomorphism 



- K’ ti) ’’A f_ 



J 4 



homogeneous in the sense 

(Tg{A){y, \t]) = dia.g{l, Kx)(Td{A){y,r]) dia.g{l, 
for all (y, 77 ) G T*Y \ 0 and all A G M+ . 
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We finally pass to an element 

^={t g ) 

for V — {E, F; J-, J^) that has (Td{A) as homogeneous principal symbol. The 
construction of the entries T, K and Q in terms of and respectively, 

is analogous to that for (2.16). □ 

2.2. A Toeplitz algebra of boundary value problems. For every L G 
Vect(T*T \ 0) there exists an element J G Vect(y') such that L is a subbundle of 
TTy J. In fact, we may choose J as a trivial bundle Y x (also written as C^) 
for a sufficiently large N . Let 



P(0) TTyJ ^ L 

be a bundle morphism that is a projection to L, such that p(o) {y, A?)) = p(o) (?/, rj) for 
all A G M-I-, (?/, rj) e T*Y\0. Then, by Theorem 1.14 there exists a P G L^i(T; J, J) 
such that P‘^ — P and p(o) = a^{P). Recall that triples of the form 

(2.20) L:-(P,J,L) 

are called global projection data and recall that P(Y) denotes the set of all such 
triples, cf. (1.19). 

Definition 2.9. Let 

(2.21) L+::=(P+,J+,L+), L_ :=(P_,J_,L_)gP(T) 

be projection data, and let P_ : P^(T, L_) — > H^{Y,J-) denote the canonical 
embedding, s G E. Moreover, let v (P, P; J_, J+), and set I (P,P;L_,L+). 
Then 5^’^(AT; /) for /x G Z, d G N, is defined as the set of all operators 

1 ) 

for arbitrary A G H^’^(X;t?). 

Theorem 2.10. Every A G <S^’^(X; Z) {with notation of Definition 2.9) in- 
duces continuous operators 

H^{X,E) H^-^{X,F) 

(2.23) A : 0 ^ 0 

p"(r,L_) P"-^(y,L+) 



for all s eR, s > d — 



Proof. It suffices to apply Theorem 1.70 to the operator A in (2.22) and to 
employ the definitions of P_ and P+, cf. (1.20). □ 
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We now introduce the principal symbolic structure of Z). By definition, 

elements in that space are 2x2 block matrices A = with An = ulc A G 

E, F). We then call 

(2.24) a^{A) := ^^^(ulc A) : tt^x E ^ 7T*x F 



the (homogeneous principal) interior symbol of A. Furthermore, the operator fam- 
ily 

(2.25) 



CTd(A) : 



1 0 
0 



ad (A) 



1 

0 



0 

r_ 



tt^E' ^ tt^F' (g) F^-^(M+) 

0^0 
F_ L. 



is called the (homogeneous principal) boundary symbol of A. Here p^{y,rj) is the 
homogeneous principal symbol of order zero of the projection P+eL0,{Y;J+,J+), 
and r_ : F_ TTyJ- is the canonical embedding. 

Let us set 



cr{A) := {a^{A),ag{A)). 



Remark 2.11. Let A £ for v = {E,F\ J-, J+), and form the 

operator 



(with notation of Definition 2.9). Then we also have A G v), if we interpret 

F+ as a map (not as iF-^(T, J+) ^ P"-^(y,L+) 

as in (2.22)), and the operator (2.22) can also be written as 



(2.27) 




0 



(with Py : H^-^{Y,Jy) F"-^(r,L+)). 

Then a{A) = 0 in the sense of B^’^(X;v), cf. (1.86), is equivalent to a{A) = 0 in 
the sense of 5^’^(X;Z). 

Theorem 2.12. (i) A e {cf. Definition 2.9) and a{A) = 0 

imply A G and (2.23) is compact for every s > d — 

(ii) ^ G <S^’^(X;Zo) for Zq := (Fo, F; U, L+), B G <S"’^(X;Zi) for h := 

(F,Fo;L_,Lo), Lq,L± G V{Y), implies AB G Zq o Zi) for 

Zq o Zi (F, F;L_,L+), and h = max(p + d, e), and we have 

a{AB) = a{A)a{B) 

{with componentwise multiplication). 

(iii) A G <S°’0(X;Z) for I := (F,F;L_,L+), implies A^ G 5°’0(X;Z*) for 
I* := (F, F; LI) in the sense of 

(^, -^*^)L2(A,E)©P0(y,L_) — {Au,v)L2(^x,F)eP0{Y,h+) 
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for all u C L‘^{X,E) 0 pO(F,L_), v e L‘^{X,F) 0 P^{Y,h^), and we 
have cr(A*) = cr(A)* (with componentwise adjoint, cf. Theorem 1.70 and 
Theorem 1.30). 



Proof, (i) Let us write A in the form (2.27) and apply Remark 2.11. Then 
we have (t{A) = 0. Prom Theorem 1.70 (ii) we then obtain A G B^~^^^(X]v) which 

implies A G /). Moreover, A is compact and so is A. 

(ii) The operators A and B can be written in the form 



A = 



0 P+7 lo ^0 



B = 



1 0 
0 Pc 



B 



1 0 
0 P_ 



with P+ from L+ = (P+, J+,L+), Pq from Lq = (Pq, Jo,Tq), R~ : P^(T,L_) — > 
and the corresponding canonical embeddings Pq • ^ 

Jo), moreover, A G vq), vq (Eq, F] Jq, J^), as well as B e 

B^'^(X;vi), Vi (E, Eq', Jq). Then it follows that 



AB = 



1 

0 



u- ; A Hi 1 



From S := Admg{l, Pq)B G B^~^^'^(X;vq o vi), cf. Theorem 1.70, we obtain 
AB G S^~^^'^(X;Iq o li). In addition, we have 



a(8) = (j(A) diag(l,po)a{B) 

where po is homogeneous principal symbol of Pq, and hence we get a^(AB) = 
a^(A)a^(B). Moreover, from 

ad(S) = ad(A)dmg(l,po)ad(B) 

= ad(A) diag(l, ro) diag(l,po)cra(P) 
with ro : Lq tt^Jq being the canonical embedding, it follows that 



ao(AB) = diag(l,p+)aa(Jl)diag(l,ro)diag(l,po)^^a(^)diag(l,r_) 
= (Jd{A)ad(B). 



(hi) Writing A in the form (2.22) for A G B^^^(X;v), v 
have 



A* 



1 0 
0 P* 



A* 



0 r: 



(P,P; J_, J+), we 



with A* G B^'^(X‘,v*) as in Theorem 1.70 (iv) and P+ as in Theorem 1.30, 
where P+ : P^(Y,L+) — ^ P^(T, J+) is the canonical embedding. This yields 
A^ G S^'^^(X;l*), cf. also the notation of Theorem 1.30. Moreover, we have 



cra(^*) - diag(l,pl)cra(^)*diag(l,r+), 

where p*_ is the homogeneous principal symbol of the projection P* and r+ : 
L+ ^ 7TyJ+ the canonical embedding. From crd{Ay = crd(A*) we then obtain 
the assertion. □ 
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Theorem 2.13. Let I := (£;,F;L_,L+) for E,F € Vect(X), L± e ViY), 
and let Aj G j G be an arbitrary sequence. Then there exists an 

element A G such that 

N 

A-Y^Aj£ 1) 

j=0 

for every N eN, and A is unique mod S~^’^{X]l). 

Proof. The assertion is an immediate consequence of Theorem 1.71 and Def- 
inition 2.9. □ 

Given A G B G for 

I := (F, F;L_,L_f.), L± := (P±,J±,L±), 

and 

m:-(P,lT;M_,M+), M± := (Q±, G±, M±), 

L±,M± G F(T), we can form the direct sum 

(2.28) AeBeS^^^{X;lem) 
for 

/ 0 m (F 0 F, F 0 IT; L_ 0 M_ , L+ 0 M+), 

Lj- 0 M;j- := {P± 0 Q±i J± 0 L± 0 M±). 

We then have 

a^{A^B) = cf^{A) 0cr^(F), aQ{A^B) = (Tq^A) 0aa(F) 
with an evident meaning of ‘ 0 ’ for the symbolic components. 

2.3. Ellipticity, parametrices, and the Fredholm property. Our next 
objective is to study ellipticity with global projection conditions. 

Definition 2.14. An operator A G S^^^{X-l) for I := (F, F;L_,L+), h± := 
(F±, J±,L±), is called elliptic, if 

(i) the interior symbol 

(2.29) a^{A) : tt^xE ^ 

is an isomorphism, and 

(ii) the boundary symbol 

7Tf F' 0 F"(E+) tt^F' 0 F"-^(M_i_) 

0'q[A) : 0 — ^ 0 

L_ L+ 

is an isomorphism for every s G M, s > max(^, d) — 



(2.30) 
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Remark 2.15. Condition (ii) in Definition 2.14 holds if and only if it is satisfied 
for any fixed sq > max(/x,d) — Moreover, this is equivalent to the bijectivity of 

TTyE' 0 iS(E+) TTyF' 0 <S(E+) 

(2.31) ad{A) : 0 ^ 0 . 

L_ L+ 

Theorem 2.16. For every operator A G E , F)tr {cf. notation (1.66)) 

such that a^(A) : 'TT^E isomorphism there exist projection data 

L± G V{y) and an element A G fori = (E", F;L_,L_^_) which is elliptic 

in the sense of Definition 2.14. 

Proof. Let us choose elements L± G Vect(5'*y) such that the relation (2.9) 
holds, and let G G B^^{X; E, F) be an operator as in Proposition 2.6. We can 
apply the construction of the proof of Theorem 2.7 and denote the operator (2.16) 
by A instead of A. This shows that the operator (2.16) has the asserted properties. 

□ 



Proposition 2.17. For every p eZ, E e Vect(X) and L G V{Y) there exists 
an elliptic element ^ S^^^{X;l) for I := (E, E;L,L) which induces Fredholm 
operators 

H%X,E) H^-^{X,E) 

T^e,l : 0 ^ © 

P^(y,L) 

for all s > max(ju,0) — such that {X;l). 



Proof. It suffices to set 






E'E 

0 




with from Theorem 1.60 and from Remark 1.32. 



□ 



Remark 2.18. Let R ^ be as in Theorem 1.60. Then 

(To{R^e) ' ^ E"(M+) ^ tt^E' 0 E"-^(M+) 

is an isomorphism, s > max(/i,0) — This implies 

ind^^y aa(E^) = 0. 

Similarly to R^ we can form an operator G E^j(X;E, E)tr in terms of the 
local symbols Ty{rj,r) := r(l(? 7 , r) (the complex conjugate), cf. Remark 1.61. The 
operator G E^’°(X; E, E) can be chosen in such a way that 

(Td{S^) : tt^^E' 0 E"(M+) ^ tt^E' 0 E"~^(M+) 
is surjective and ker^-^y ao{S^) = ^[tt^E']; this yields 
(2.32) mds*ya9{S^^) = p[7rlEl 
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Theorem 2.19. Let A e I := (£■, F;L_,L+), be elliptic. Then 

there exists an elliptic operator B C S^’^{X;m) for m := (F, F; M_, M+) with 
suitable projection data M± c F(T) of the form M± := (Q±,C^,M±) for some 
N gN, such thatA^B € B^^^{X;v), v := (F©F, F0F; C^, is SL-elliptic. 

Proof. Choose any s e N, s — p > 0, and set Aq := : L‘^(X, F) 

L2(X,F), cf. Theorem 1.60. Then we have tIq ^ B^^^{X;E,F) and 

ind^.y (Jd{Ao) = ind^^y cra(A) = [L+] - [L_]. 

For the L^-adjoint Aq G F, E), cf. Theorem 1.70 (iv), we have 

mds*Y (^d{AQ) = [F_] - [Fy] 

as well as ind^^y <Ja(^i) = [^-] - [L^] for Bi := G B^^^{X-F,E) 

with some type e G N. The operator Bi can be written as F + Gi for a certain 
B G F, F) and a Green operator Gi G Bq^{X\ F, F), and then 

inds.K <Jd{B) = [L_] - [L+], 

because aa(Gi) is a family of compact operators in the respective Sobolev spaces 
on My. 

There are bundles My, M_ G Vect(F*T) such that M_ 0 F_ = My 0 Fy = 
C^, and we obtain 

inds.y <Td{B) = [M+] - [M_], 

Applying Theorem 2.7 and the proof of Theorem 2.16 we find an elliptic oper- 
ator B G S^'^{X\m) for m = (F, F;M_,My), M± = (Q±,C^,M±), such that 
ker^^y (Jd{B) = My, coker^^y ad{B) = M_. The operator B is then as desired. □ 

Definition 2.20. Let A G for I = (F,F;L_,Ly), Ly G V{Y). An 

operator V G for l~^ (F, F;Ly,L_) and some e G N is called a 

parametrix of A, if the operators 

(2.33) Ci:=I-VA and Cr := I - AT 

belong to S~^'^^{X\mi) and m^), respectively, for certain di.,dr G N, 

mi := (F,F;L_,L_), and := (F, F;Ly,Ly). 

Theorem 2.21. Let A G p g Z, d G N, v := (F,F;L_,Ly) for 

F,Fg Vect(X), L± gF(T). 

(i) The operator A is elliptic if and only if 

H^{X,E) F"-^(X,F) 

(2.34) ^ : 0 ^ 0 

P^(T,L_) P"-^(F,Ly) 

is a Fredholm operator for an s = sq gR, sq > max(/i,d) — 

(ii) If A is elliptic, (2.34) is a Fredholm operator for all s > max(/x,d) — 
and dimker^ and dim coker ^ are independent of s. 
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(iii) An elliptic operator A has a parametrix V G {in the 

sense of Definition 2.20) for di = max(/i, d), = {d — , and V can 

he chosen in such a way that the remainders in the relation (2.33) are 
projections 

Cl : H\X,E) 0 P"(y,L_) ^ V", : iP“^(X,F) 0 P"-^(y,L+) W 

for all s > max{p^d) — for V := ker^ C F) 0 F'^(y, L_) 

and a finite- dimensional subspace W C F)0P^(y, L+) with the 

property W + im A = H^-^{X,F) 0 P"“^(y,L+), ly n im^ - {0} for 
every s > max(/i, d) — ^ . 

Proof. Let^ e S^'^{X\l)A (F,P;L_,L+), be elliptic. Choose an elliptic 

operator 3 G <S^’^(X;m), m := (P, F;M_,M 4 .) as in Theorem 2.19 such that 
^0P G v) is SL-elliptic. Applying Theorem 1.75 (iii) we find a parametrix 

{A^B)^~^^ G v~^), such that the remainders I—{A^B)^~^\A®3) 

and X — (^ 0 B)(A 0 BY~^"> are of type d/ = max(/i,d) and dr = {d — ^)+, 
respectively. For the principal symbolic components of (^0 we have 

cr^{{A^B)^~'^^) = a^(^)“^ 0(j^(P)~^ 

and 

(Td{{A 0 = (Ta{A)~^ © <7d{B)~^. 

In particular, 

7T^E'®H%R+) 



(2.35) 



(Jd{{A®B)^ 



L+ 

© 

it^E' (g) H^-f^{R+) 



L_ 

0 

7t^P'0P"(M+) 



M+ M_ 

is an isomorphism which induces isomorphisms (Td{A)~^ and ad{B)~^ between the 
respective bundles separately. In particular, by omitting the third row and column 
of (2.35) we obtain a morphism 

TT^P' 0 P"-^(M+) 7TfP'0P"(IR+) 

(2.36) (Td{Vo) : 0 0 



which is the boundary symbol of an operator Vo ^ B ^^^{X;w) for w := 
(P, P;C^,C^) such that cr^(Po) = <^v^(‘^)~\ Riid (o-^(Po)) restricts to 

TT^P' 0 P"-^(R+) TTf P' 0 P"(R+) 






<re(.A) ^ : 



L_ 
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Thus, if we set 



Vo 



0 

Pl_ 



Vo 



0 



with the projection Pj, : 

Rl+ : P*-^(r,L+) ^ H^{Y,C^), we obtain an operator Vo e (X; r 

such that 



P®(y, L_) and the canonical embedding 

/ -\A I — In 



’y^i'Po) = a^{A) 



-1 



o-aTo) = <^d{Ay 



Thus we have C[* := 1— Vo A £ S~^'‘^yX; mi), and :=I—AVo G mr), 

cf. Theorem 2.12 (i), (ii). 

Let us form JC ~ Theorem 2.13, and set Vi := (X — JC)Vo 

which belongs to Then it follows that J — ViA G 

In an analogous manner we find an operator Vr G such that X — 

AVr G S~^'^^{X;rrir). In other words, there is a left parametrix Vi and a right 
parametrix Vr of vA, i.e., we may set V :=Vi. Prom Theorem 2.12 we thus obtain 
that (2.34) is a Fredholm operator for every s > max(//, d) — The assertions of 
Theorem 2.21 (ii) and (iii) now follow in a similar manner as the analogous ones 
of Theorem 1.33 (ii), (iii), again by applying Remark 1.8 to the present situation. 
Thus, to complete the proof of Theorem 2.21 it remains to show that the Fredholm 
property of (2.34) for an so > max(ju, d) — ^ entails the ellipticity. 

If (2.34) is a Fredholm operator for s = sq > max(jU,d) — |, also 



.4o := 

is a Fredholm operator 

L^X,E) L^{X,F) 
(2.37) ^0 -0 — ^ 0 , 

pO(T,L_) P0(T,L+) 



cf. the notation in Proposition 2.17. If we show the ellipticity of Ao, we also obtain 
the ellipticity of A itself, because the order reducing operators are elliptic, and 
compositions of elliptic operators are again elliptic. To simplify notation we write 
A Ao’ We now proceed in a similar manner as in the proof of Theorem 1.33 
and use the same notation as in (1.35), (1.36), (1.37) (with Y in place of M). Then 
we can form the operator 



/I 0 0 

P := 0 P+ 0 

\0 0 Pi 



A o' 

0 E 



L‘^{X,E) L‘^{X,F) 

0 ^ 0 
L^{Y,J-) X2(r,J+0 J_) 



The operator A is Fredholm as a map (2.37). Hence there is a 

L‘^{X,E) L‘^{X,E) 

Q: 0 0 

pO(y,L+) pO(y,L_) 
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such that 

L\X,E) L^{X,E) 

I -QA: 0 0 

P0(F,L_) P^{Y,L.) 

is compact. Let 

L^X,F) L\X,F) 

S 0 — > 0 

(y, j+ 0 j_ ) po (r, L+ ) 0 po (y, Li ) 



denote a projection. Then 



T := 



Q 0 
0 E 



L\X,F) 
o S ‘ 0 

L2(y,j+© j_) 



L^{X, E) 



L\Y,J_) 



has the property that Z — TB =\ JC is compact in the space E) 0 L^(y, J_). 

Since J — /C is a Fredholm operator in the latter space, it follows that dimker(J — 
X) < 00 , and hence dimkerP < oo since 



ker P C ker(J — /C). 

The operator : L‘^{X,E) 0 L‘^{Y,J-) -> L^{X,E) 0 L‘^(Y,J_) belongs to 
B^^^{X;w) for w := (P, P; J_, J_) and is Fredholm. From Theorem 1.75 (i) we 
know that B*B is elliptic. It follows that both a^{A) and (Jd{A) are injective. By 
passing to adjoint operators in an analogous manner we can show that a-tp{A) and 
cFd{A) are also surjective. This completes the proof of Theorem 2.21. □ 



2.4. Reduction to the boundary. Let 

(2.38) A= 

for I := (P, P; 0,Li), G P(T), i = 1, 2, be two elliptic boundary value problems 
for the same <T^-elliptic operator D G P, P) (without loss of generality we 

assume the type d in Ai to be independent of i). 

We want to reduce the operator A 2 to the boundary by means of Ai . By virtue 
of Theorem 2.21 (hi) there are parametrices Vi G They have 

the form of row matrices 



(2.39) V^ =: (G, P,), 

where Gi is an analogue of Green’s function of the boundary value problem Ai, 
and Ki is a potential operator. Using 

4iPi = (j 



for nir := (P, P;Li,Li), we obtain 

(2.40) T 2 K 1 ) mod5-°°>(‘*-^)yX;m), 
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for m := (F, F;Li,L 2 ), and we have 

Q:=T2/^i GT°(y;Li,L2), 

cf. Definition 1.22. Because both A 2 and Pi are Fredholm operators, also 

Q:F^(y,Li)^P^(y,L2) 

is Fredholm, and indQ is independent of s, cf. Remark 1.38. 

The operator Q is called the reduction of A 2 to the boundary by means of Ai . 
The following result is an analogue of the Agranovich- Dynin index formula. 

Theorem 2.22. Let Ai, z = 1,2, be two elliptic operators (2.38). Then we 
have 

indA 2 — indyli = indQ. 

Proof. The assertion follows from the relation (2.40), using the fact that 
smoothing remainders are compact operators and ind P\ = — ind A\. □ 



Remark 2.23. Let Ai, be two elliptic operators (2.38) for = {Pi, J, L) with 
the same bundles J, L but different projections Pi, i = 1,2, and assume Ti = PiT 
for the same trace operator T. Then, if Pi : P^{Y, Li) H^{Y, J) is the canonical 
embedding, we have (in the notation of (2.40)) 

T 2 K 1 = P 2 R 1 

modulo a compact operator and hence, using Proposition 1.18 and notation (1.17) 

ind ^2 - ind^i = ind(Fi,F2)* 

This is a consequence of the fact that when K denotes the potential operator that 
appears in the parametrix construction for A\ as in the proof of Theorem 2.21 we 
have ad{T)ao{K) = id as a map L L. 

Remark 2.24. The procedure to reduce elliptic elements of S^'^{X,li) with 
the same upper left corners to the boundary can be generalised to arbitrary I = 
{E, F;h-^i,h^^i), i = 1,2. The algebraic technique is the same as in [31, Section 
3. 2. 1.3]. There is then an immediate analogue of Theorem 2.22 for the general case. 



3. Transmission operators and Cauchy data spaces 

3.1. Transmission operators. Let M be a closed compact manifold 
which is subdivided into compact manifolds and A_ with common 
boundary Y, i.e., 

M-x+ux_, r = A+nx_. 

An example is M = 2X, the double of X, where two copies of X are glued together 
along Y = dX. 

Given an elliptic operator A G L^^{X; V, W), V,W ^ Vect(M), we can consider 
the restrictions 

A± := 4|i„t e Li‘i(intX±T±,W±), 
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Lt := V^lintXi, W± := lyiint We want to study the question to what extent 
the index of the Fredholm operator 

A : V) W) 

can be compared with Fredholm indices of elliptic boundary value problems for 
A± on the ±-sides X± with respect to Y. 

At first glance, such a problem appears very natural, for instance, when A is 
an elliptic differential operator. However, in the pseudo-differential case there is a 
basic analytic problem: The operators A± have not necessarily the transmission 
property at the boundary Y (which is, in fact, the exception). Moreover, in general 
there do not exist Shapiro-Lopatinskij-elliptic boundary conditions for A± (also 
for differential operators), although there are always elliptic projection conditions, 
cf. Theorem 2.16, when the transmission property is satisfied. 

For convenience, we first consider the case M = 2X and aissume that A has 
the transmission property at Y. Let r^ denote the operator of restriction from M 
to int X± and e^ the operator of extension by zero from int X± to M. Moreover, 
let e be the reflection map that maps a point G to its counterpart x_ G X- 
and conversely; then Y remains fixed. We use 6 as a diffeomorphism £ : ^ A_ 

as well as e : X- (this should not cause confusion). 

We then have 

(3.1) r+^e+ € B^^’°{X+-,V+,W+),r- Ae~ € 
and 

(3.2) r+Ae-e*, £*r-yle+ e B^’°{X+-,V+,W+), 



(3.3) T~Ae+e*, e*r+^e“ e B^’°(X^;V-,W-). 

Let us first assume that Aq e L°i(M;V,W) is an elliptic operator. The ellipticity 
of Ao is equivalent to the Fredholm property of the operator 

Aq: L^{M,V) L‘^{M,W), 



cf. Theorem 1.7 (i), or, equivalently, of 

b ^0®"^ ^ ^oe-J i2(^x_,V-) L^{X-,V-) 



Writing X := Ei := F+, E 2 := £*V-, Fi ;= F 2 this is equivalent 

to the Fredholm property of 



(3.4) 



r+Aoe+ r+Aoe 
s*r“Aoe'^ e:*r“Aoe~5* 



L\X,Ei) L\X,Fi 



L\X,E2) L\X,F2) 



By assumption, Aq has the transmission property at Y ; recall that this condition 
is symmetric with respect to both sides X±. Thus we have A G B^^^'{X\Ei 0 
E 2 ^F\ ® F 2 ). Because of the Fredholm property of (3.4) the operator A is elliptic 
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in 0 E 2 ,Fi 0 F 2 ), cf. Theorem 1.75 (i). In other words, the symbols 

<j^(A) : TT^iEi 0 E 2 ) 7t^(^i © F 2 ) and 

(3.5) Gd{k) : 'k^{E' 0 E') 0 L2(R+) 'K*y{F' 0 F') 0 L^{R+) 

are isomorphisms. Here we use that E' E[ = E '2 and F' F{ = F^. Let 
us write A := {Aij)ij = 1 ^ 2 - The boundary symbols era (A 12 ) : npE' ^ F^(R+) ^ 
TTyF' 0 L^(Ry) and 

^^a(A2i) : tt^F' 0 L^{R^) ^ n^F' 0 L^{R^) 

take values in compact operators, because 

Ai 2 G A21 G £2^1), 

cf. the relations (3.2) and (3.3). Since (3.5) is a family of isomorphisms, we therefore 
have 

(3.6) ind^^y cra(A) = ind^*^ cra(An) + ind^^y (Ja(A 22 ) ^ 0. 

Let us also consider the boundary symbols <Ta,(±)(') of r^Aoe^ with respect to the 
plus - and the minus - side, i.e., as operators in the space F^’^(Xy ; Fi, Fi) and 
F^’°(X_; F 2 , F 2 ), respectively. 

Let denote the operator push-forward under the reflection diffeomorphism 
£ : M — > M. We have 

All = r'^Aoe"^ and A 22 = r“^(e>,Ao)e“^ 

and 

inds-y <Ta,(+)(r+(£.Ao)e+) = inds-y (Ta,(_)(r“Aoe“). 

Together with the relation (3.6) we thus obtain the following result. 

Proposition 3.1. Let Aq G L^^{M;V,W) be an operator with the transmis- 
sion property at Y . Then we have 

(3.7) inds-y (Ta,(+)(r+Aoe+) + inds-y aa,(_)(r" Aoe“) = 0 
((3.7) is interpreted as a relation in K(S'^Y)). 

Let us now consider an arbitrary elliptic operator A G F^j(M; V, VF)tr- We use 
the fact that there is an operator Ry G P, P)tr such that 

= r+fi(^e+ : V) ^ L\X+,V+) 

is an isomorphism with the inverse r+Fy^e+, cf. Remark 1.61. Let us set Aq 
ARy^. We then have 

r+Aoe+ = (r+Ae+)(r+F“^e+) + G 

for some G G F^’^(X+; Vy, W+). Because of ind 5 *y (Ja(r+Fy^e+) = 0, cf. Remark 
2.18, and since ad{G){y^r]) is compact for every (^, 77 ) G S*Y, it follows that 

(3.8) ind^.y ^Ja,(y)(r+Aoe+) = ind^^y aa,(+)(r+Ae+). 
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On the other hand, we have 

Y~AQe~ = {t~ Ae~){r~ Ry^e~) 

which implies 

(3.9) ind^.y cTa,(_)(r“^oe“) = inds*y o- 9 ,(_)(r“^e“) 

+ mds.ycTg, (_)(!'■ 

= inds.ycTa_(_)(r“yle“) -/i[7rj'£;'], 
cf. (2.32). Moreover, the relations (3.8) and (3.9) yield 

inds-y aa,(+)(r+.4oe+) + indg.y <ra_(_)(r“j4oe') 

= inds.y o- 9 ,(y)(r+yle+) + ind^.y crg,(_)(r“yle“) - h[ttIE']. 
Together with Proposition 3.1 we thus proved the following theorem. 

Theorem 3.2. For every elliptic operator A G V, VP)tr 'we have 

inds*y <Ta,(+)(r+Ae+) + indg.y cra,(_)(r“yle“) = ^l[KlE'] 
for E' :=V^|y. 

We want to specify the latter result for the case that A := D is an elliptic 
differential operator 

(3.10) D : H^{M, V) W) 

of order fi eN on M. In this case we know that 



(3.11) 

and 


ad^(^+){D) : 7 v*yE' ® H^R+) 




(3.12) 


<Ta,(_)(D) : n;.E' 


^7T^F'®//"-'‘(R+) 



are both surjective, s — a > — (Recall, cf. Remark 1.74, that we always have 
E' ^ F'.) The kernels 

ker^^y cra^(y)(F), ker^*y as^-){D) 
are then subbundles of tt* J for J := F' 0 . . . 0 F' (yu summands). 

Proposition 3.3. The Cauchy data spaces 

L+{y,v) ■= {(Diu\t=o) ■ 

ue E' ®S{R+), (Ta,(+)(i?)(?/,?7)M = o| 

for, Dt-= and 

L-{y,v) {(Diu\t=o) ■■ 

u G E' 'S>S(R-), (Ta_(_)(D)(iy,r?)M = o|, 

{y^rj) G S*Y form complementary subbundles L± o/0j~qF', i.e. we have 
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(3.13) ker5-=.y aa,(y)(D) 0 ker^^y — 0j^i7T*£^'. 

The proof of this result will be a consequence of Lemma 3.4 below. In the 
splitting of variables x = {y^t) eY x (—1,1) in a tubular neighbourhood of Y we 
write the operator D in the form 

(3.14) D = j2^j{t)Di 

j=0 

with coefficients aj{t) G (7°®((— 1, 1), Diff^“-^ (y; F')), Dt = We then have 

(3-15) <79,(±)(D)(y,r?) = '^a^{aj{0)){y,r])Di 

j=o 

on 3 t, where cr^(aj(0)) is the homogeneous principal symbol of order ijl — j of 
the operator aj{0) G Diff^~-^ (T ; E\ F'), (y, rj) G T*T \ 0, j = 0, . . . , /i. 

Lemma 3.4. Let 

k=0 

he an m X m system of operators on R with constant coefficients. Assume that 

(i) G GL{mX), 

(ii) invertible for a// r G R. 

Then for 

L± := |z)fw(0))fc=o....,M-i e C™'' : « € 5(1±, C”*), = o} 
we have Ly 0 L_ = 



Proof. Without loss of generality we assume 6^ = idc^, otherwise we pass 
to a new system with coefficients The equation Au = 0 is equivalent to the 

system 

ii-i 

0 ^ ^ hj^U]^ = 0 , 

k=0 

DfUj — Ujj^i =0 for j = 0, . . . , y — 2, 



or 



for 



(Dt^J^U = Q for 



0 1 
0 0 

0 0 

V-&0 -h 



0 ... 0 \ 

1 ... 0 



0 ... 1 

-62 ••• 
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We then have 

L± = {[/|t=o € C™'' : f/ e 5(1±,C’"''), (^Dt ~ A^U = o}. 

The matrix r — A is invertible for all r G M if and only if condition (ii) is satisfied, 
i.e., if spec(^) fl M = 0. Let A G spec(^) and set Sp{\) := {z G C : |z — A| = p}. 

We have ^Dt — A^U = 0 and U\t=o =: Uq if and only if U{t) = and 






AEspec(^) 



for every sufficiently small 0 < p < 1. Let us set spec±(>l) = {A G spec(^) : Im A ^ 
0}; then spec(^) = spec_|.(.4) U spec_(^). Since, by assumption, spec(^) f1 R = 0, 
we have 



AGspec+(^) 



AGspec_(^) 



and 

U{0) = Uo= Y1 nAf/o+ HaC/o, 

AGspec^(>4) AGspec_(^) 

where Ha := (27tz)“^ — A)~^d( is the projection to the eigenspace of A to 

the eigenvalue A. 

We have 

for every A G spec(v4) and 



±[ 

2m Js 



e'*SC - 4)“UC = e*^V(0 



Sp(A) 

for a suitable polynominal p{t) (with mii x mp matrix-valued coefficients) of order 
m(A) — 1 where m(A) is the multiplicity of A. This gives us 

L+ = ( ^ ^A)c'"^ L_ = ( ^ nAjc'"^ 

AGspec_|_(^4) AGspec_(v4) 



and hence L+ 0 I/_ = 



□ 



Remark 3.5. We also have 



{Dt-A) 







= 0 



(3.16) 
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for every A G spec(^) and 0 < p < dist(A,0), i.e., 

(3.17) Ux = {2ni)~^ [ - A)~^dC = {2Tri)~^A f {(-A)~^^. 

JSp{\) JSp{\) ^ 

Thus, if we set G C : Im^ = for some sufficiently small <5 > 0, 

r+(r_) oriented with increasing (decreasing) ReC, it follows that 



(3.18) 



V± := 



AGspec^(A) 



c ■ 



Moreover, every solution of 

(3.19) {Dt-A)U = 0, U\t=o = Uo 
can be written in the form 

(3.20) (/(.) . ^.A e»‘« - e«« - 

Now let D be as before an elliptic differential operator of order p, regarded as 
a map 

(3.21) D : H^{M, V) L^{M, W), 
cf. formula (3.10). Choose arbitrary elliptic elements 

e5'^’^(X±;4), 

for D± := r^L>e=*=, /+ := (V"+ , 0, L_^), /_ := (VT, IT_; 0, L_) for suitable 

projection data h± = {P±^ J^L±)] according to Theorem 2.16 there always exist 
such operators T±. Recall that trace operators T± have the form T± = P±T± for 
suitable trace operators T± G V±,W±\ 0, J). In view of the ellipticity we 

have the Fredholm operators (3.21) and 

L‘^{X±,W±) 

( 3 . 22 ) m{X±,V ±) © 

po(y,L±) 

We now derive a relation between their indices. To this end we consider the fol- 
lowing diagram 

0 — > m{M,V) M+eM- L‘^iY,J) — > 0 

(3.23) v\\b ji? 

0 < — L^{M,V) ^ ^ L^{Y,J) < — 0 

for M± := H''(X±, V±), and A/± := L^{X±, W±) © P°{Y, L±). The maps i and j 
are defined as follows: 

i{u) ■- u\x+ © u\x_ , i(w+ © M~) := “ 7-M-) 

for 7 ^/ f\y^, with being the derivative in normal direction to Y and 

\y^ the restriction to Y from the ± side. The symbol A^/ denotes any element of 
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L^yO^]E',E') that induces isomorphisms H^{Y,E') ^{Y,E') for all s G M. 

The map a is the canonical embedding, where we use 

(r, j) = p" (y, L+ ) © p" (y, L_ ) 

for s = 0. The map b is the canonical projection, using L?{M, W) — L^(X_i_, fy+)0 
{X- , W - ) . Moreover, we set 

(3.24) P:=P+0P_ and P:=P+0P_, 

where B± G are parametrices of V±. Finally, we define 

(3.25) R:=jo8oa: L^{Y, J) ^ L^{Y, J) 

which is an elliptic pseudo-differential operator on Y and, as such, Fredholm. The 
rows of the diagram (3.23) are exact, and we have 

D = b oT> o i. 

The assumptions of an abstract lemma (see, e.g. Rempel and Schulze [31, Section 
3. 1.1. 3]) are satisfied, and we thus obtain the following index formula. 

Theorem 3.6. With the notation of (3.25) we have 
ind D = ind P+ 0 ind P_ + ind P. 

3.2. Examples. We now turn to a number of specific observations and ex- 
amples. Consider the unit circle 

:= {w e C : \w\ = 1} 

in the complex plane, and write the space L^(5^) (with the scalar product 
(u,u)l 2 (m^) = u{(p)v((p)d(p) as a direct orthogonal sum 

L2(pi) = 1T+0VF“ 
for 

[K : j G N ]], W- : j G N ]] 

(where [[...]] denotes closed subspaces spanned by the elements in the brackets.) 

Theorem 3.7. The orthogonal projections 

P± : L^(5^) ^ 

are elements of L^^{S^). 

Proof. Let us set 

F+ := {(Fi^,e+/+)(r) : f+{t) G L^{M+)}, 

V- := {(Ft-.,e-/_)(r) : /_(<) G L^(R-)j, 
where F = Ft^r is the standard Fourier transform on E. The canonical projections 

n± : L^{R) ^ 






can be written in the form 
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with the characteristic function 6^ of E±. If x{t) ^ C^{R) is any excision function 
in t (i.e., x(^) = 0 for \t\ < cq, x(t) = 1 for \t\ > ci for certain 0 < cq < Ci) we 
have 

n+ = FxQ^F-^ + F(1 - x)0^F-\ 

where the operators F(l — x)B^F~^ are smoothing. Since x^^ ^ follows 

that 

(3.26) E L^i(E). 



We now consider the isomorphism 



T : L^(5^) L2(R) 

by setting (Tw)(r) := 2(1 + iT)~^u{w{r)) for 



We then have 



T{w^) 



(1 — irY 






' (1 + ’ 

for j E N, TW^ = and 

(3.27) P± = T-^U^T. 



, {^ + iry 
' (1 — ir)J+i ’ 



Using (3.26) we see that the operators P± belong to L^^{S^) because of the invari- 
ance of pseudo-differential operators under diffeomorphisms. □ 



Remark 3.8. Let a(r) E 5°,(R) be a symbol with constant coefficients. We 
then have continuous operators 

(3.28) op^(a) r”^ op(a)e“^ : L^(M_(_) L^(R+) 

and 

op~(a) := r“ op(a)e“ : L^(M_) ^ L^(E_). 

The operator (3.28) can equivalently be formulated as 

U^Ma : ^ 

where Ma is the operator of multiplication by the function a. In particular, to- 
gether with the following Remark 3.9 we see that boundary symbols (1.54) can be 
reformulated as ((y, ? 7 )-dependent families of) Toeplitz operators on the circle. 

Remark 3.9. An operator of the form 

(3.29) A := P+MaP+ : 

for an a{w) E 0^{S^) is a Toeplitz operator (in classical notation). Ma is the 
operator of multiplication by a in LA{S^). We have (in the terminology of Definition 
1.22) a canonical identification of (3.29) with 

(3.30) pIReT^(S'^L,L). 
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Here, A := Ma, P ■= P+, R : W+ L^{S^) is the canonical embedding, and 
L = (P, C,L) G V{S^) for a bundle L G Vect(T*S'^ \ 0) that is isomorphic to 
(S^ X M_^) X C, where x is the plus-component of T*5^ \ 0 = x R+) U 
(5^ X R_), and P°(*S'^,L) = Ellipticity of (3.29) in the sense of Definition 
1.31 (i) is equivalent to a{w) / 0 for all re G 5^. 

Clearly if we admit arbitrary operators A G we obtain much more 

general operators than (3.30) (also for = 0). 

3.3. Spectral boundary value problems. We now consider general (non- 
homogeneous) elliptic boundary value problems for differential operators as a spe- 
cial case of our pseudo-differential calculus, where we have more explicit infor- 
mation (the material of this section is based on the author’s joint papers [46], 
[30] with Nazaikinskij, Sternin, and Shatalov.) They are a natural generalisation 
of (homogeneous) boundary value problems, studied (in an set-up) by Atiyah, 
Patoti, and Singer [4]. 

Let A be a compact manifold with boundary Y, n = dim A, and let A 
be an elliptic differential operator on X of order fi with smooth coefficients up to 
the boundary, 

(3.31) A:C^{X,E) (X, F) 

for E^F e Vect(X). In a collar neighbourhood of Y in the splitting of variables 
X = (y,t) ^Y X [0, 1) the operator A can be written in the form 

(3.32) A = j2Mt)Di, 

j=0 

Dt := with coefficients Aj G (7^([0, 1), Diff^“-^(F)). The ellipticity of A 
implies that 

(3.33) A^{0) :E' -^F' 

(for P' E\y, F' := F|y) is an isomorphism. The boundary symbol 

(3.34) <T9(A){y,v) = J2a4A,{Q)){y,rj)Di : H^{R+,E') ^ 

j=0 

(with a^{Aj{0)) : TTyE' — > TTyF' being the homogeneous principal symbol of order 
/i — j of the operator Aj(0) G Diff^“-^ (T ; E', F')) is a surjective family of Fredholm 
operators, parametrised by (i/,ry) G T*Y \ 0. Thus, as in the general calculus of 
boundary value problems, there is a kernel bundle 

(3.35) L+ := ker ad{A) G Vect(T*T \ 0). 

Let us consider the family of differential operators on Y 

(7c{A){w) ;= ^ + (0)w^ 
j=o 



(3.36) 
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parametrised by the complex variable w G C. 

Remark 3.10. We have 

for every 7 G M, and ac{A){p + i'y) is parameter-dependent elliptic with parameter 
/3 gR, cf. Agranovich and Vishik [1] . Moreover, there exists a countable set D C C 
such that 

D C\{w : c <lmw < c'} 

is finite for every c < c' and 

(3.37) (Jc{A){w) : H\Y,E') ^ H^-^{Y,F') 

is an isomorphism for every w £ C\D and s G M. 

The bijectivity of (3.37) for large |Reu;| is a well known phenomenon of 
parameter-dependent elliptic operators, holomorphically dependent on w. First, 

(3.37) is a holomorphic family of Fredholm operators (kernels and cokernels are 
independent of s), and for large |Reu;| the operators are isomorphisms, cf. The- 
orem 1.11 (i). Then there is a countable set C C of non- bijectivity points with 
the asserted properties, cf. also [35, Section 2.2.5]. 

Let us set 

(3.38) 

j=0 

regarded as a differential operator on the infinite cylinder T x R. The coefficient 
Aj{0) : E' F' is an isomorphism. For convenience, we set J = F' and 

assume A^(0) == 1 (otherwise we compose (3.38) from the left by A“^(0)). Let us 
write B in the form 

/x-l 

(3.39) B = D^ + Y,bjD{ 

j=o 

for bj := Aj{0) G Diff^~^(T). The pull back of the bundle J to Y x R will be 
denoted again by J. 

Let H^{Y X M, J) denote the (cylindrical) Sobolev space on T x E, of smooth- 
ness s G R, defined as the completion of {Y x R, J) with respect to the norm 

{ j W{T)u{T)\\l^^Y,J)d-T'] ' - 

where R^{r) G L^^iY; J, J;Rr) is any classical parameter-dependent elliptic pseu- 
do-differential operator of order s on T, with parameter r G R. Moreover, set 

LT"’^(r X R, J) := t) :ue H^{Y xR, J)} 

for every 7 G R. The operator B then defines continuous maps 

(3.40) B : x R, J) ^ x R, J) 

for all s, 7 G R. 
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Let US reformulate the equation Bu = f 

(3.41) DtU ~AU = F 

for U := . . . , F := ^(0, . . . ,0, /) and Uj D{u, j = 0, . . . ,/i — 1, and 

/ 0 1 0 ... 0 

0 0 1 ... 0 

(3.42) ^ : : 

0 0 0 ... 1 

\—bo —bi —62 • • • —b/j,-! 

Note that det(u; — A) — YHjZl bjwF 
Lemma 3.11. The operator 

(3.43) ^ : 0 J) ^ 0 J) 

is invertible for a w e C if and only if so is 

^-1 

(3.44) w'" + (L J) J) 

j=0 

for any 5 G E. 7n other words, we have spec^ = {il? G C : ac{A){w) is bijective}. 
Moreover, we have 

(3.45) {w — A)~^ = ac(A)~^{w)Q{w) 

for a matrix Q{w) = {Qjk{w)) , of differential operators polynomially 

dependent on w, where Qjki'w) is parameter- dependent with parameter j3 {for 
w — p F ^7) of order fi — k F j for k = j = 0,..., fi — 1 . 

Proof. The formula (3.45) is elementary, and the proof gives the character- 
isation of the entries of the matrix Q. 

As a consequence of (3.45) we see that the operator (3.43) is invertible if 
so is (3.44). Conversely, the inverbility of (3.43) entails that of (3.44) because 
(7c{A)~^{w)f is equal to the first component of {w — B)~^^{0, . . . ,0, f). □ 

Remark 3.12. The set spec(A) is countable, and every strip {ly G C : c < 
Imxe < c'} only contains finitely many elements of spec(^) for arbitrary reals 
c < c'. The operator function {w — A)~^ is meromorphic with poles of finite 
multiplicity at the points of spec(^), and the Laurent coefficients of {w — A)~^ at 
{w — k eN, are operators in L~^(Y\ J, J) of finite rank. 

In fact, ac{A){w) is parameter-dependent elliptic with parameter Ren; on ev- 
ery line Imii; = const, and invertible for large | Reie|. Then the asserted properties 
follow from the relation (3.45) together with classical results of Agranovich and 
Vishik [1], cf. also [39, Section 1.2.4]. 
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Similarly to the considerations in Section 3.1 we want to formulate a relation 
between the spectral points of the operator A (which is the same as the set of 
non-bijectivity points of (3.37)) and Cauchy data spaces of Sobolev distributions 
on X at Y . To this end we interpret (3.39) as a continuous operator 

B : H^{Y X M+, J) H^~^{Y x E+, J), 

where H^{Y x J) := H^(Y x M, J)|e^xT: and H^{Y x E, J) is the cylindrical 
Sobolev space on F x E. The latter space is defined as the completion of C^(Y x 
E, J) with respect to the norm 

|y ll-R*W«P)llL(y,j)C*'r| 

for any choice of an order reducing family R^{r) G T^i(F; J, J; E) in the sense of 
Theorem 1.12. An equivalent definition for s G N is 

H%Y X E, J) = {u{y,t) e L^{Y x E, J) : 

D^D^u{y, t) €L‘^{Y X R, J) for all |a| + A: < s}. 

Here Dy runs over the set of all differential operators on Y of order \a\, acting 
between sections of J. 

For convenience, we assume that the set D of Remark 3.10 does not intersect 
the real line Imw = 0. Otherwise, we can pass to a translated operator {Dt — 
^7)^ + ~ ^ suitable real 7 with a corresponding shifted set Dj 

in the complex plane which does not intersect the real line. 

For any integer s > /i we form the Cauchy data space 

C^’^{Y,J) := {(D^u{y,0))k=o ^ x «+)}■ 

We then have 

fi-i 

(3.46) J) = 0 H^-'^-i{Y, J), 

k=0 

and the operator := ^(r',r'Dt, . . . ,r'D^~^) with t'u := u\t=o defines a contin- 
uous map 

(3.47) : F"(r X E+, J) ^ C"’^(F, J). 

We want to formulate results on the solvability of the boundary value problem 

(3.48) Bu+ = H^-^{Y X E+, J), 

(3.49) r^u^_=p+GC"’^(F,J). 

It turns out that, in general, not the whole space C^’^(F, J) of boundary data 
on the right hand side of (3.49) is induced by solutions U-^ e H^{Y x E_|_, J), but 
a subspace which is the image under a suitable pseudo-differential projection V+. 
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Similarly to (3.48), (3.49) we can also consider a boundary value problem on 
the negative half-cylinder 

(3.50) Bu- = f-e X M-, J), 

(3.51) = g- 

The admissible boundary data g- are then determined by the corresponding com- 
plementary projection V- . 

The projections V± are obtained as follows. First recall that the spectrum 
spec(^) = D (in the notation of Remark 3.10) does not intersect the real line 
Imw — 0. Therefore, we have 

(3.52) spec(^) n — c < Imu; < c} = 0 

for some c > 0. Let us fix some 0 < .s < c, set 

r± := {w = T ± i{c — e) : r G M}, 

oriented in direction of increasing r on F+, and descreasing r on F_, and form 

(3.53) V± = :^A [ (w-A)-^—. 

Note that the operator A can be written in the form 

(3.54) A = nAiTZ-^ 
for 

(3.55) 7^ = diag(7^°,7^i,...,7^[r''-'^) 

where IZj : H^{Y^ J) H^~^{Y, J) is an order reducing operator of order —k in 
the sense of Theorem 1.12, and A\ is a system of operators of order 1. Then V± 
takes the form 

( 3 . 56 ) 

Lemma 3.13. (i) The integral (3.53) stronly converges in J) on 

the dense subset J) for every s G M. 

(ii) The operators V± form a matrix (^±jfc)o<j</i-i,o</c</i-i of elements 
of (Y;J,J). Thus V± extend to continuous operators 

V± 

for all s G M. 

Proof, (i) From Lemma 3.11 we know that the entries of the matrix {w — 
A)~^ are claissical parameter-dependent pseudo-diflFerential operators of order < 
— 1, with parameter r G M (when we identify M with F+ or F_ via r w = 
r ± 2 (c — e)). In fact, (Tc{A)~^{w) is parameter-dependent of order — /x, and the 
orders of the entries of Q{w) are < /x — 1, cf. formula (3.45). By virtue of Theorem 




ELLIPTICITY WITH GLOBAL PROJECTION CONDITIONS 



415 



1.9 the - norm of every entry of {w — A)~^ can be 

estimated by Cs(l + |tc|)~^, w G F±, for a constant Cg > 0. 

This gives us immediately assertion (i). 

(ii) Let us write V± in the form (3.56). Then it suffices to observe that 



1 

27TZ 




A)-' 



dw 

w 



is a matrix of classical pseudo-differential operators of order —1. The technique of 
the proof is similar to [48] . □ 



Let us write the operator (3.42) in the form A = {Akj)i<k<^j,,o<j<fi-i, 

A : J) 

k=l 

and interpret the orders ovd Akj = k — j in the Douglis-Nirenberg sense, with 
homogeneous principal symbols (T^{Akj){y,T]) of order k — j. Setting 

^'ip{A){y j Tj) =■ {o’^(^Akj){y<)Tj))i<k<ijL,o<j<fj,— i 

we conclude that cT7/;(v4)(y, 77) equals 

/ 0 1 0 ... 0 \ 

0 0 1 ... 0 

0 0 0 ... 1 

\-a^{bo){y,rj) -a^{bi){y,rj) -a^{b 2 ){y,rj) ... -a^{b^-i){y,rj)J 

Moreover, set 

L±{y,ri) ■= {“(0) : u(t) E S(R±,Ey), (^Dt - a^{A){y,rf}^u = o|, 

E = J. 

Theorem 3.14. (i) The operators V± are complementary projections, 

i.e., = V±, V-^ + V~ — 1, and have the property 

(3.57) V±A^AV±. 

(ii) The homogeneous principal symbols o‘^{V±jk) of order j — k ofV±jk ^ 
^ci” (^5^7^) (^/* Lemma 3 . 1 s (ii)) form projections 

{<yi,{V±,jk){y,ri)) =: (y^{V±){y,r)) : Ey L±{y,r{) 

along L^[y,r)). 

(hi) The operator functions {w — A)~^V± are holomorphic in spec(^) fl {w ; 
Imu; ^ 0}. 
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Proof, (i) First note that the relation (3.57) is evident. Moreover, to verify 
that + V- = 1, it suffices to observe that 



A 



1 

27ri 



lb 



w - A)' 



dw 



w 



for a small circle Fq clockwise surrounding the origin; by Cauchy’s residue theorem 
the integral is equal to 27TiA~^. 

Let us now calculate V‘1 (the consideration for V- is analogous and left to 
the reader). Set F+ + ie for some sufficiently small £: > 0. Then, using the 

relation (3.57) and the resolvent identity we have 



^ 27T ^ ^ 



w{w — w') 



— [(if;' - A) ^ - {w - A) dif; > dw' 



= lo + h 



for 



dw 



dw' 



( 271 ) w{w-w')j w' 

- -{0 b '“--* i ~'^ ' 

which vanishes, since the inner integral is zero, and 



p/^ w'{w — w') I w 






dw 



dw' 



w{w — w') j w' 



b 



A 

2m 



A\ ^ . f . , .. _i dw' 

f {w'-A)-^^+ [ 

I 1 ir+ w' Ir {w')^ 



2 

dw' 



= n. 



dw 



In the first line of the latter relation we inserted L -7 77 

7 - w[w~w') 

the second line A = A — w' -\-w'. 



7 T = 2m{w') and 



(ii) is simple after the considerations in the proof of Lemma 3.4. 

(iii) Let Im 11 ; > 0. Then we have 

2m 

A 

2m 



(w-A) ^r+ = -^ f {w'-A) 

2m Jr w' 



[ iw' A)~^ A{w - A) ^ f dw' 

i Jp^ w'{w — w') 2m Jp^ w'{w — w') ' 




ELLIPTICITY WITH GLOBAL PROJECTION CONDITIONS 



417 



The second integral on the right hand side vanishes, and the first one is holo- 
morphic for Imit; > 0. □ 

In the following we employ the Fourier-Laplace transform 

pOO 

(F«)(C)=m(C)= / e-^^<u{t)dt, 

Jo 

ImC < 0, with the inverse 

-1 poG-{-i5 

(F~^u){t) = -^ j e‘*yu(y)dy, t > 0 

27T J_ao+iS 

for S < 0,y = ReC- 

Let us define the maps 

(0,...,0,z) 

and 

Q:C^^C, Q{zo,...,z^^i) := zq. 

Theorem 3.15. The boundary value problem 

(3.58) Bu = fe X R+, J) 

(3.59) V^T^u P+C"’^(r, J) 

has a unique solution u e H^{Y x M+, J), given by 



(3.60) u = QF-i|(^-^)-i E{f{w))-ig-^ {z - A)~^ E{f{z))dz 

The corresponding map 1Z : {f^ g) ^ u is continuous as an operator 

(3.61) 7^ : H^-^{Y x M+, J) 0 F+C"’^(y, J) ^ H^{Y x R+, J). 



Proof. We show that 7^ is a right inverse of the operator the 

consideration for the left inverse is left to the reader. Concerning the continuity 
(3.61) we refer to [ 30 ]. 

It is convenient to pass from B to the operator V := Dt — A with A being 
given by (3.42) and the vector function as in (3.41). Then we can omit the 
mappings Q and E which only single out the first components of U and replace 
by r', the restriction to t = 0. 

Let us set 

n = {s K) 



for 



Sf F ^{w-A) 

Kg := —i lim F~^(w — A)g. 
^ t^+o ^ 
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We then show the relations 

(3.62) VSf = /, VlCg = 0, 

(3.63) V+ = 0, V+ICg = g 

for / and g belonging to the respective spaces. 

We have 

(3.64) VSf = {F-^{w-A)F}{F-\w-A)f{w)} 

- ^VF-\w - A)-^ (z-A)-^f{z)dz. 

The first summand on the right hand side of (3.64) is equal to /. So it remains to 
observe that 

VF-\w-A)-^h = 0, 

h = — ^ Jp (z — A)~^ f{z)dz (the latter vector is independent of w). For similar 
reasons it follows that VJCg = 0. 

For P+/C we have 

(3.65) V^JCg = -i\im^V^F-\w-A)-^g 

= lim — A)'~^g dw. 

t^+o 2m Jy_ 

For t > 0 the exponent in has a negative real part in the upper complex w half- 
plane. Therefore, we can deform the contour of integration to a curve ‘surrounding’ 
spec_^(^) {X ^ spec(^) : ImA > 0} (which is a countable set which intersects 
every strip {in G C : c < Imic < c'} in a finite set for arbitrary c < c', cf. Remark 
3.12. An elementary consideration shows that the limes on the right hand side 
of (3.65) is just V-\.g. By assumption we have V.^g — g, so it follows the second 
relation of (3.63). In remains to check the first equation of (3.63): 

P+ - ^)-i |/(«,) - ^ ^ {z- A)-^f{z)dz 

= F~^V+{w - A)~'^f{w)\t=o - ^ j V+{z - A)~^J{z)dz = 0. 

□ 

Let us now consider the operator (3.31) on a compact manifold with 
boundary T , where we fix a collar neighbourhood = T x [0, 1) 3 (x, t) of Y . As in 
the cylindrical situation we then have for the Cauchy data spaces for 

any integer s > g, E' = E\y , ^ continuous operator 

: H\X,E) 

and a pseudo-differential projection 
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Concerning the non-bijectivity points of the induced operator family (3.37) we 
make the same assumptions as before, i.e., that there are no such points on the 
line Ren; = 0. 



Theorem 3.16. The spectral boundary value problem 

(3.66) Au = f 

(3.67) = ge P+C"’^(r, E') 
defines a Fredholm operator 



(3.68) ( ]-.H\X,E)^ © 

for every s > /a. 



More general boundary value problems with a modification of the trace oper- 
ators are studied in [ 46 ]. Boundary value problems of type (3.68) as well 

as those of [ 46 ] are special cases of elliptic problems of Section 2.3, up to a slight 
modification of the orders of the trace operators which may consist of components 
of different order. In fact, similarly as (3.56) we can form 

r± = tioF f _ Ao)-^—tZo^ 

2m w 

with a diagonal matrix TZq = diag ^ )^^q and Aq = AIZq. 

Set 




which are pseudo-differential projections 

P±: 0 H\Y,E')^ 0 H^{Y,E') 

0</e</x-l 0</e<At-l 

of the class (y ; 0o<fc<^_i E', 0o<fc<^_i E'^ . The operator Uq 

Tlo: 0 H^Y,E') ~^C^’>^{Y,E'), 

0<fc</x-l 

and (3.68) can be transformed to an equivalent boundary value problem 

(3.69) (^):H\X,E)-^ © 

P+H^Y,(Bo<k<^.-iE') 

for T = 7^o 
Setting 

L+ = I A) E', ima^ E' 

\ 0</c<^t— 1 0<k<ii—l 
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we have 

p+h^Iy, 0 £') =p*(y,L+), 

and the operator (3.69) is elliptic in the sense of Definition 2.14. Thus, Theorem 
3.16 is an immediate consequence of Theorem 2.21 (i). 

3.4. Calderon-Seeley projections. In the present section we discuss an- 
other way of constructing pseudo-differential projections to Cauchy data spaces 
of solutions to elliptic differential equations, cf. also the author’s joint paper [47] 
with Tarkhanov. 

Let 

A:C^{X,E) -^C^{X,F) 

be a differential operator on a compact manifold X with boundary Y; E,F G 
Vect(X). Moreover, let M be a manifold (countable at infinity with a Riemann- 
ian metric) containing X as a submanifold with boundary. Let E,F e Vect(M) 
such that E = E\x^F — F\x, and let 

A:C^{M,E) -^C^{M,F) 

be a differential operator with A = A|x- 

Let := intX, and interpret the characteristic function xn as an operator of 
multiplication 

for s > /J. = ord A. Then the distributional kernel of the commutator 

[A Xn] = Xn^ 

(as a map C^{M,E) V'{M,F)) is supported on T x T. Moreover, / G 

i7f^^(M, E), s > /i, and T^f = 0 imply [A, xn]f = 0. 

We now assume that there is an operator P G F, E) such that 

(3.70) APf = /, PAu = u 

for all (distributional sections in the respective bundles) / and u, supported in an 
^-neighbourhood of X in M for all 0 < s < Sq for some Sq > 0. 

In the following we employ the operators e+ and r+ in the same meaning as 
in Section 3.1. Set ^ _ 

A ;= r+Ae+, P := r+Pe+. 

Proposition 3.17. Let A be an elliptic differential operator with the above- 
mentioned properties. Then 

G:=1~PA 

{as an operator on H^{X,E), s > p = ord A) belongs to the space Bq^{X;E,F) 
{cf. the notation (1.88)) and satisfies 

(3.71) 
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Proof. By virtue of Theorem 1.70 we have G G E, F). We then 

obtain G G Bq^{X\ E, F) from Remark 1.68. 

Let us now verify (3.71). First we have the relation 

(3.72) AP = 1 

as a consequence of (3.70) and of the fact that A is a differential operator. Thus 
P : H^~^(X, F) — ^ H^{X, E) is a right inverse of A. This yields a projection PA^ 
and G is just the complementary projection. □ 

Remark 3.18. Let s> and set 

ker, A^{ue H^{X, E) : Au = 0}. 

Then 

(3.73) G:H\X,E) ker^ 
is a projection to ker^ A. 

In fact, u G kers A gives us Gu = u, and for arbitrary f G H^iX, E) we have 
AGf = yl(l - PA)f = Af- {AP)Af - 0. 

Proposition 3.19. The operator (3.73) can be written in the form 

fi-i 

(3.74) G = ^KjoT, 

j=0 

with {unique) potential operators Kj G {X]Q, F; E\0) {cf. Remark 1.69). 

Thus f G H^{X, E) and T^f = 0 entails Gf = 0. 

Proof. We have G — 1 — PA G Bq^{X;E^F), and Remark 1.69 gives us a 
representation (1.89). Since PAip = ip for every (p G G^{Tl,E), the operator Gq 
vanishes. This yields the relation (3.74) which implies the second assertion. □ 

Theorem 3.20. Let A satisfy the ahovementioned assumptions. Moreover, let 
T~^ he any right inverse of the map 

(3.75) : H^X, E) E'), 

cf (3.46), (3.47) forE' = J. 

Then 

n r^Gp -^ : c"’^(r, e') ^ c^^{y, e') 

is a projection to the Cauchy data space of solutions of Au = 0, u e H^{X,E) 
{called the Calderon- Seeley projection) . 

Proof. Let g = T^u for some u G ker^ A. Then we have T^{u — T~^g) = 
0 and hence, by Proposition 3.19, G{u — T~^g) = 0, which entails GT~^g = 
Gu = u (by Remark 3.18) and 11^ = T^u = g. For arbitrary h G C^'^{Y,E') 
we have T~^h G H^{X,E) and GT~^h G keVgA by Remark 3.18. This yields 
me Takers A. □ 
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Remark 3.21. (i) The operator II is independent of the choice of T 

In fact, if is another right inverse of we have 

_ r^GT~^ = r^G{T-^ - T~^) = 0 

because T^{T~^ — = 0, cf. the second assertion of Proposition 

3.19. 

(ii) The operator II is also independent of the specific choice of P, because 
for another Pi the associated projection G\ = 1 — P\ A has the property 
that GiT~^q G ker^ A has the Cauchy data g: the same is true of 
GT~^g, i.e., - Gi)T~^ = 0. 

Remark 3.22. Assume that the operator A has the unique continuation prop- 
erty of solutions. Then 

:ker,A^C"’^(T,P') 

is injective, i.e., there is a unique solution u G keVs A for every g G IIC®’^(y, P') 
such that T^u — g. 

4. Remarks on the edge calculus with global projection data 

4.1. Boundary value problems without the transmission property. 

In this section we want to make some remarks on the role of the transmission prop- 
erty of boundary value problems in connection with Chapter 2 . Pseudo-differential 
operators that appear as parametrices of elliptic differential operators have always 
the transmission property, cf. Definition 1.44. On the other hand, there are inter- 
esting cases of pseudo-differential operators on a manifold with boundary, where 
the transmission property is not satisfied, for instance, for operators obtained by 
a reduction to the boundary of some mixed elliptic problem. 

A classical example of a mixed problem is the Zaremba problem for the Laplace 
operator with jumping boundary conditions, with Dirichlet conditions on one part, 
Neumann conditions on the other part of the boundary. 

In mixed problems the boundary is subdivided into (smooth) submanifolds 
with an interface of codimension 1 as the common boundary. The solvability can 
be discussed in terms of boundary value problems (or transmission problems) on 
the boundary with respect to the interface. Typical operators in this context have 
\t]\ (the absolute value of the covariable rj on the boundary) as the principal symbol; 
those fail to have the transmission property at the interface. In general, operators 
with principal symbols |?7|^, /x G M, have the transmission property with respect 
to any interface of codimension 1 if and only if is an even integer. 

This shows, in particular, in a situation as at the beginning of Section 3.1, 
that the transmission property of the operators A± only holds in exceptional cases 
(although always in the case of differential operators). 

The general program to construct an operator algebra of boundary value prob- 
lems for the case without the transmission property and with global projection 
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conditions at the boundary is carried out in Schulze and Seiler [45]. This pa- 
per also contains an analogue of Theorem 2.21 for elliptic operators without the 
transmission property. 

The pseudo-differential analysis of boundary value problems and parametrices 
for the Ccise of Shapiro-Lopatinskij ellipticity are studied in Rempel and Schulze 
[32], and further in [38] and [43] . Another (earlier) approach of Vishik and Eskin 
[52], [53], [12], is not organised in terms of operator algebras with complete and 
smooth symbolic structures. 

The algebra property for boundary value problems with or without the trans- 
mission property fits into the concept of edge problems with a specific kind of 
operator-valued symbols, see also Section 4.2 below. This point of view has been 
developed in [38] , cf. also [33] . Let us also note that mixed and crack problems have 
been systematically investigated in a new monograph jointly with Kapanadze [ 22 ] 
and in the author’s joint papers with Harutjunjan [18], [19]. More details in the 
context of parabolic mixed and transmission problems may be found in Krainer, 
Schulze and Zhou [24]. 

4.2. Edge problems. Boundary value problems for differential (and pseudo- 
diflFerential) operators on a smooth manifold with boundary have much in common 
with problems for operators on a manifold with edges. This is based on the fact 
that the ‘half-space’ Q x for an open set H C ^an be regarded as a wedge 
with model cone M+ and edge 0. To illustrate this, let A = aa{x)D~ be a 

differential operator in x with coefficients aa{x) G x M+). Inserting 

X = (y, t) for y G n, t G M+, the operator A takes the form 

(4.1) A = t~^^ apj{y,t){tDy)°‘ 

with coefficients af 3 j{y,t) ^ x R+) for all j,(3. 

A differential operator A in x of the form (4.1) will be called edge- 
degenerate. Clearly, the class of such operators is much larger than that induced 
by operators with smooth coefficients. 

One may ask, whether the calculus of boundary value problems with the trans- 
mission property at ^ = 0 in the sense of Section 1.3 has an analogue for edge- 
degenerate operators, with an adequate substitute of the standard Sobolev spaces, 
a corresponding generalisation of trace and potential boundary conditions at t = 0, 
Shapiro-Lopatinskj ellipticity, etc. Such a calculus is possible, indeed, and for the 
wedge X R_^, or, more generally, a manifold X with boundary, it is just 
a special case of a corresponding calculus on a manifold W with edge Y. Geo- 
metrically, such a IT is a space such that both W \ Y and Y are manifolds 
(dim Y — q, dim W \Y = n+ l + y), and every point y ^Y has a neighbourhood 
V which can be represented (via a ‘singular chart’) in the form x for an 
open set Q C M'? and a model cone 
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with base N which is a closed compact manifold. The nature of transition 
maps and other details may be found, for instance, in [42]. 

Note that the class of edge- degenerate operators of order 2 contains the La- 
place-Betrami operators (as well as other geometric operators) when IT \ T in the 
local splitting of variables into (y,t,x) is equipped with a ‘wedge metric’, e.g., 

dt^ + fgN{t,y) + dy^, 

where y) is a family of Riemannian metrics on N smootly depending on (t, y) 
up to t = 0. 

An example is IT X for a manifold X with boundary dX. In this case 
we have Y — dX, and A is a single point, i.e., — M_|_. 

The pseudo-differential algebra of edge problems (say, for the case that W is 
compact) consists of 2 x 2 block matrix operators 

E) VV"-^’^-^(lT, F) 

(4.2) A: 0 ^ 0 

of order /x C M. Compared with (1.90) the shift of smoothness by {n + l)/2 on the 
edge is not essential for the calculus; a reduction of order on Y allows us unify 
the orders of the spaces on Y to H^(Y,J-) and J+) respectively. The 

spaces (for the trivial bundle E on W with fibre C) are contained in 

\ Y). Near Y in the variables (y, x, t) G x X x the spaces 
are of the form 

(4.3) 

cf. Definition 1.52, for a certain scale of weighted Sobolev spaces /C®’^(X^) on the 
infinite stretched cone = N x R_^, cf. [ 35 ], [ 39 ], or [ 11 ]. The group action 
on the space is given by : u{x^t) u{x^Xt), X G M+. An easy 

modification of this construction for the case of arbitrary E G Vect(TT) then gives 
us the spaces Vy^’^(IT, E). The operators (4.2) form a so called edge-algebra that 
contains all edge-degenerate pseudo-differential operators in the upper left corners, 
cf. [ 34 ], [ 39 ], [ 11 ]. 

If IT X is a manifold X with boundary, the edge-algebra contains all 
pseudo-differential boundary value problems without the transmission property as 
a subalgebra, cf. [ 38 ] or [ 43 ]. Similarly to the calculus in Sections 1.2 and 1.3, 
the 2x2 block matrix structure reflects additional trace and potential conditions 
with respect to the boundary which satisfy an analogue of the Shapiro- Lopatinskij 
condition in the elliptic case. 

In the general case, on a manifold IT with edge T, we have corresponding edge 
conditions of trace and potential type, again with an analogue of the Shapiro- 
Lopatinskij condition as an ellipticity condition for the so called principal edge 
symbol (Ja (.4) which is the second component of the principal symbolic hierarchy 

a{A) = {(T^(j{A),a^{A)) 
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in the edge algebra (the first component is the edge-degenerate principal 

interior symbol of A). Ellipticity of A in the edge algebra requires the bijecticity 
of both components. 

The edge symbol a^iA) is an analogue of the boundary symbol (Jd{A) from the 
situation of boundary value problems. In the edge algebra it consists of a family 
of operators 

E'y 0 F'y 0 

(4.4) a^{A){y,r]): 0 ^ 0 

J_ J+ 

parametrised by (y,rj) G T*T \ 0; here E' = E\y F' = F|y. Similarly to the 
relation (1.87) we have homogeneity of order y in the sense 

(4.5) aA{A){y,Xr]) = diag(/^A, id)c7A(^)(2/, 77) diag(/«^\ A“^ id) 
for all A G E+, {y,r]) G T*T \ 0. 

The Shapiro-Lopatinskij condition is just the bijectivity of (4.4) for any 5 G E 
(it entails the bijectivity for all s G E; the weight 7 G E is kept fixed). We also 
talk about crA-ellipticity of the corresponding operator A. 

Now, for a cr^-elliptic operator 

(4.6) A : E) ^ F) 

we can ask the existence of a 2 x 2 block matrix operator A in the edge algebra, 
containing A in the upper left corner, with suitable bundles J± G Vect(T), such 
that A is <Ja - elliptic. 

The answer is similar as in the case of boundary value problems, cf. the In- 
troduction. First, because of the relation (4.5), it suffices to look at {y,rf) G S*Y . 
Then 

(4.7) ^A(^)(y,r7) : E'y^JC^^^N^) ^ 0 /C^-^’^-^(TV^) 

is necessarily a family of Fredholm operators, parametrised by the compact space 
S*Y. An analogue of the Atiyah-Bott condition (0.17) in the present case is then 

(4.8) mds*ya^{A)e7r^,K{Y), 

7Ti : S*Y Y. We then have the following theorem. 

Theorem 4.1 ([35]). Let (4.6) be a a^-elliptic operator for which (4.7) is a 
family of Fredholm operators. There is then a a ^-elliptic operator A in the edge 
algebra containing A in the upper left corner if and only if condition (4.8) is 
fulfilled. 

Theorem 4.2 ([39]). (i) Every a /f)- elliptic operator A in the edge 

algebra has a parametrix within the calculus. 

(ii) The ellipticity of A entails the Fredholm property of the operator (4.2) 
for every s G E. 
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Index formuicLS for elliptic operators in the edge algebra have been constructed 
in Fedosov, Schulze, and Tarkhanov [13], and Nazaikinskij, Savin, Schulze, and 
Sternin [29]. 

Nazaikiskij, Savin Schulze, and Sternin [27], [28] constructed large classes of 
(j^-elliptic operators on manifolds with edge for which the condition (4.8) is not 
satisfied. 

It is now again an interesting problem to extend the edge algebra to an edge- 
Toeplitz algebra such that every -elliptic operator A admits an elliptic problem 
with global projection conditions on the edge Y. 

Such an algebra was constructed in Schulze and Seiler [44]. All essential ele- 
ments of the calculus of Section 1.3 have a natural analogue in the edge-Toeplitz 
algebra. 



4.3. Analysis on manifolds with singularities. Ellipticity of (pseudo-) 
differential operators and parametrix constructions within a calculus with symbolic 
structures are an interesting program also on manifolds with higher (say ‘polyhe- 
dral’) singularities. Locally, such spaces can be generated by iteratively forming 
cones and wedges, starting from smooth compact base manifolds. The correspond- 
ing analysis refers to specific geometric properties, for instance, whether edges and 
corners are regular or cuspidal. Let us make here a few remarks on the case of regu- 
lar polyhedra with their system of lower dimensional edges. An example is a cube 
in with its two-dimensional faces, one-dimensional edges, and corner points. 
Outside the corner points close to the one-dimensional edges the configuration is a 
manifold with edges (with boundary), outside corners and one-dimensional edges 
it is a manifolds with boundary. Thus, a calculus in the cube should contain 
both edge and boundary conditions. 

Operator algebras on manifolds with ‘higher’ singularities have been con- 
structed and investigated in many variants, cf. [36], [14], [41], [42], [23], [25]. 
The operators are connected with trace and potential operators on the lower- 
dimensional strata, and ellipticity of corresponding higher edge/corner problems 
contains a hierarchy of Shapiro- Lopatinskij conditions. 

There is then also a hierarchy of topological obstructions for such edge condi- 
tions, and it would be necessary to study Toeplitz extensions of the corresponding 
operator algebras, in order not to rule out (‘most of the’) interesting operators. 

In this connection, the basic questions are still open, and the analysis of elliptic 
operators and their index theory on stratified spaces is an awarding task for future 
activities. 
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On the tangential oblique derivative problem 
— methods, results, open problems 

Peter Popivanov 



Abstract. An introduction to the oblique derivative problem for second or- 
der elliptic operators is presented. The main ideas and methods are illustrated 
by means of model examples. The investigation involves subelliptic pseudo- 
differential operators in Sobolev and Holder spaces, microlocal analysis, and 
Fredholm theory. At the end, two open problems are proposed. 



Introduction 

This paper can be considered as an introduction to the oblique derivative 
problem for second order elliptic partial differential equations. We consider the 
boundary value problem (bvp) 

3u 

(0.1) Lu = F in n, — = g on dO., 

where L is a second order elliptic differential operator and I is a smooth real- valued 
nondegenerate vector field tangential to some part E of the boundary dO. The 
boundary value problem (0.1) was considered for the first time by H. Poincare when 
studying the tides in the oceans. The vector fields appearing in these investigations 
are always tangent to the celestial bodies surfaces at the points of some curves or 
more massive sets. Another application of (0.1) is found in the theory of strong 
Markov processes with continuous paths in the interior of such as Brownian 
motion in the case of diffusion and absorption phenomena on 90, see [P-Pl], [Pa]. 

Prom the mathematical point of view the problem (0.1) is of great interest 
because it is probably the first example of a bvp violating the famous Shapiro- 
Lopatinskij condition. As it is well known, this condition is satisfied at each point 
in which I is not tangential to 90, that is, when E is empty. Assuming that 
E = 0, the bvp (0.1) turns out to be of Fredholm type and therefore it has finite 
dimensional kernel and cokernel. Moreover, (0.1) is solvable for given F and g if 
and only if they satisfy finitely many orthogonality conditions. The corresponding 
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theory is valid in Sobolev spaces , Holder spaces , and Besov spaces. Observe 
that in this case there is no loss of regularity of the solution it, i.e., if F € 
and g 6 then u G 

The qualitative behavior of the bvp (0.1) changes drastically when I becomes 
tangential to dQ. At first, it is assumed that F is a smooth submanifold of dfl 
of codimension 1 and that 1\e transversal to E. Let n(x) be the unit outward 
normal to dfl at the point x G F. The following three cases may occur: 

(i) {l(x) , n(x)) > 0 for every x G F, 

(ii) (/(x), n(x)) changes its sign on 50 through F from minus to plus in the 
direction of the vector field /(x), 

(iii) (^(x),n(x)) changes its sign on 50 through F from plus to minus in the 
direction of /(x). 

In the case (i) the vector field I is called a field of neutral type] in the cases (ii) and 
(iii) it is called a field of emergent and suhmergent type, respectively. In these two 
cases a new effect of loss of regularity of the solution u appears, contrary to the 
nontangential case. The bvp (0.1) with a neutral type vector field I on 50 is the 
only one of Fredholm type. In the case of an emergent vector field /, the bvp (0.1) 
has an infinite dimensional kernel. In order to guarantee the Fredholm property of 
the problem, the values of u should be prescribed on the set of tangency F. Even 
under this additional condition we will have loss of regularity of the solution u. The 
most difficult situation appears when I is of submergent type. In fact, in this case, 
the bvp (0.1) has an infinite dimensional cokernel as it is not even locally solvable 
in a neighborhood of each point x G F. This strange effect can be explained by 
the discontinuity of u (with finite jump) on F. In other words, a classical solution 
u of (0.1) does not exist for arbitrary F and g. It is more convenient to look 
for a solution u in the class C‘^{Q \ E) allowing the existence of a finite smooth 
jump {u}e of u on F. As it was proved in [Mz-Pa], for any sufficiently smooth 
function (F, p) from a subspace in L 2 (ft) x L 2 {dQ) of finite codimension, there 
exists a solution u G C‘^{Q\E) that satisfies (0.1) on fI\F. This solution is unique 
modulo a finite dimensional subspace of C^(fl\F). Moreover, the restriction u\qq, 
has a finite smooth jump {u]e that can be determined by (F^g). 

The main tools in studying the tangential oblique derivative problem are the 
energy estimates in appropriate functional spaces. In some papers, the central 
results are proved avoiding the pseudodifferential approach. Nevertheless, the in- 
vestigation of the tangential oblique derivative problem ‘in general’, and the even- 
tual construction of a parametrix, are rather complicated tasks and use modern 
methods of harmonic analysis and pseudodifferential operators (^DO) including 
the study of subelliptic operators, the Calderon projector on the boundary 5fl, 
Fourier integral operators (FIO) with real and complex valued phase functions on 
Sobolev and Holder spaces, canonical transformations, etc. 

The present paper is an extended version of the lectures given by the author 
at the EPAG conference held in Potsdam, Germany, in August 2001. The author 
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supposes some initial knowledge of the reader in the area of pseudodifferential 
operators on Sobolev spaces, and some small experience in microlocal analysis. 

This paper is divided into two parts. The first section deals with the investi- 
gation of some model examples in the theory of pseudodifferential boundary value 
problems. A small introduction in the theory of subelliptic ^DO is proposed, and 
a detailed proof of the subellipticity with sharp loss of regularity in Sobolev spaces 
is given. Again, by means of simple examples, the cases of emergent and submer- 
gent vector fields are considered, and the corresponding modified bvp are stated 
and studied. Calderon projectors on the boundary and canonical transformations 
for ^DO on Sobolev spaces are discussed, too. A few words are mentioned about 
the oblique derivative problem in Holder spaces and the difficulties arising there. 

The second section of this article may be considered as a short survey on the 
general theory of the tangential oblique derivative problem. Once the examples of 
modified bvp are stated and studied in Section 1, the reader might take for granted 
similar results formulated in a more general situation. Certainly, the qualitative 
properties of the solutions of (0.1) given in Section 1 and Section 2 are the same. 
While the proofs in Section 1 are more or less elementary, the rather complicated 
proofs in the ‘general case’ can be found in many papers or in some monographs. 
We particularly recommend the very well written book by Paneah [Pa] that con- 
tains many deep and interesting results on the subject. 

At the end of our exposition, we propose two open problems that are of some 
interest for the further development of the tangential bvp in Holder classes and 
for fully nonlinear second order elliptic differential operators. 

Acknowledgment. The author would like to thank Prof. B.-W. Schulze, 
Prof. T. Krainer, and Prof. J. Gil for inviting him to participate in the EPAG 
conference in Potsdam, and for the opportunity to give two lectures on the famous 
Poincare problem: The tangential oblique derivative problem. Special acknowledg- 
ment is due to Prof. Gil and to Prof. Krainer for their precise editorial work. 



1. Subelliptic operators and their application to 
the tangential oblique derivative problem 

1.1. Subelliptic estimates. In this section we will study the oblique deriv- 
ative problem for some simple examples in order to show the main difficulties and 
tools in proving the famous subelliptic estimates. We are not going to develop the 
whole theory but rather illustrate the main results and give an idea of how the 
machinery of Calderon projectors, pseudodifferential operators, and Fourier inte- 
gral operators works in this situation. We will concentrate on the Sobolev case, 
but we shall also formulate some results concerning the subelliptic estimates in 
the Holder spaces. 

Let us consider in 

= {{x,Xn+i) e : a; = (a:i,. . . ,a:„) G R”,a:„+i > 0} 
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the boundary value problem 



( 1 . 1 ) 



Alt = 0 
du du 



jn+1 



W = ^ = 9{x) on {x„+i = 0}, 



where (p G C'°°(1R'^), g G Let Dj = for 1 < j < n + 1. In the case 

n = 1, the operator D\ — iip{xi)\Di\ arises on the boundary. Obviously, it is an 
elliptic ^DO on the real line. We will concentrate on the degenerate problem (1.1), 
i.e., we will assume that the real- valued function ip vanishes at some points. 

Denote by the partial Fourier transform of u{x^Xn-\-i) with respect 



to X. Then we have 









0, and therefore 



Having in mind that u should be a tempered distribution with respect to x, we 
get u — and u(x,0) — c{x). Thus, 

(1.2) g{x) = [ +(/9(xi)|$|)c(0rf^, where = (27r)“"d^. 

JRri 

We point out that — is the outward normal vector field to the boundary 

{xn-\-i — 0} of (1.1), and the symbol of the operator in (1.2) is i^i + (^(xi)|^|. 

Let if{xi) = ax I with a ^ 0, /c G N. There are four cases to be studied in this 
situation, see Figure 1 and Figure 2. 



Definition 1.1. A classical ^DO P of order m is called subelliptic if there 
exists some 0 < ^ < 1 such that for each compact set AT C O and for each real s, 
one can find a positive constant Ck,s for which one has 

(1-3) ||m|U < + I|m||s-i) 

for all u e Cg°(K). 

Here || • ||s stands for the norm in the standard Sobolev space One can 
easily prove the following properties of a subelliptic ^DO P (cf. [El], [H2]): 

(1) The estimate (1.3) holds if and only if it holds for some fixed sq. 

(2) If Pu e ifiQ^(O) and u G V'{Q), then u G Because of this 

property the number 6 is called loss of regularity of P. 

(3) The adjoint operator P* of each subelliptic operator is locally solvable 
about each point Xo G fl. 

(4) To study the estimate (1.3), it is sufficient to consider the special ceise 

m = 1, s = 1 — J. In fact, if p^(x,^) is the principal symbol of the 
operator P, ord^p® = m, then we can set and consider 

an operator Pi having pj(x,^) as principal symbol. It follows that P is 
subelliptic with loss of regularity 6 if and only if Pi is subelliptic with 
loss of regularity S. Note that ord^pj = 1. 
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a > 0, k even a > 0, A; odd a < 0, k odd 

I (neutral v.f.) II (emergent v.f.) Ill (submergent v.f.) 



Figure 1. Structure of the vector field I near the set of tangency. 




I {I neutral) II (/ emergent) III (/ submergent) 



Figure 2. Local behavior of (f near 0. 



(5) Without loss of generality we can assume that in a conical neighborhood 
of the point (xo,^^), > 0, Pi(xo,C^) = 0 the principal symbol pj = 

+ a(x,^), ord^ a = 1, a G is real valued, = 0, a{xo,^^) — 
0. To prove this fact we use two important results. At first, if Pi is a 
subelliptic 'LDO, then Pi(xo,^^) = 0 implies Vx,^Pi(a:o, ^^) ^ 0, and 
Vx,^ Pi(xo, C°) is not colinear to (^°, 0). Assume for the sake of simplicity 
that ^RepJ(xo,C°) ^ 0. The application of homogeneous canonical 
transformations [El] leads to the microlocal form pi — i^i + a(x,^). 

Next we will formulate two theorems that play important role in the investi- 
gation of subelliptic operators. Detailed proofs are given in [El] and [E2]. 

Theorem 1.2. Assume that P{x, D) is a classical first order subelliptic At DO. 
Then, for each /c G N and for each K C there exists a constant C{K) > 0 such 
hat the a priori estimate 



my)\\o < ||Tf + D\-^)i,{y)\\^ 

(1-4) ° 1 

^S-{k+l){l-S) ||^/3^a^||^;^|a|(l-25) 1 



|a+/3|</c+l 
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holds for each x e K, ^ with |^| = A > -0 € Here, 



\a+P\<k 



where (x,^) = d^d^f(x,0 for f e C°°{T*{n) \ 0). 



Theorem 1.3. Let P{x, D) he a first order classical "^DO with principal sym- 
bol p° and assume that for each K C Q, there exist two constants C{K) > 0^ 
N = N{K) > 0, and a function e(A) > 0 with e{\) ^0 as A 0^ such that the 
following a priori estimate 



(1.5) 



IIV'llo < c\ A'*||T^"’V( 2 ^ + + 

+ e{X) 

|a+/3|<JV 



holds for each (x,0 G T*{K), |4| = 1, A > 1, G C^CK"), where ^ 
Then one can find a constant Ck > 0 such that 

(1.6) ll«l|i-5 < OdT^llo + ||w||o) 

for all u G C^{K). 



Theorem 1.2 enables us to find an interesting necessary condition for the subel- 
lipticity of large claisses of ^DO. 



Theorem 1.4. Consider a first order P{x,D) with principal symbol 

p^ = in a conical neighborhood of the characteristic point {xo,£,^), 

= 1 {i.e. = 0, a(xo,^^) = 0). Assume that the real-valued function a{x,^), 

ord^ a = 1, satisfies the following conditions: dl^a{xo,^^) = 0 for 1 < j < k — 1, 
7 ^ 0 for some k eN, and dl^\/x',^'a{xo,(,^) = 0 for 0 < j < ^, where 
I is an integer such that 0 < I < k, x' = (x 2 , . . . ^Xn), and = (^ 2 , • • • ^^n)- Then 
the a priori estimate 

(1.7) l|u||i_, < C{\\Pu\\o + ||u||o), n € C^{K), 

is violated for 5 < if Xo E K. 

Remark 1.5. Theorem 1.4 is also valid without the assumption 

=0 for 0 < j < ^. 

Proof of Theorem 1.4. Obviously, / > 1. We apply Theorem 1.3 with k = 
I — 1 and we get the following estimate 

||V'(y)l|o < c{x^\\T^ff”^p°ix, + yX^-\C + DX-^)i^{y)\\o 

|q+/3|<; 



( 1 . 8 ) 
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for all Ip € Evidently, 0 < ^ < implies J — ^(1 — ^) < 0. Having in 

mind the fact that — ^ , we can assume 

without loss of generality that ¥< S. We will consider several cases. 

Case {a): I = 1 and so 0 < (^ < ^. Then (1.8) takes the form 

IIV'llo<c{A^lb'’(:ro,nV'l|o+ E 

|a+/3|<l 

Now, letting \ —> oo we get 

||t/<||o <CJ2 ll^“^llo for all b € Co°“(K"). 

|a| = l 

For £ > 0 sufficiently small {e — > 0), the previous inequality is violated for the 
function 'ipe{y) = '0(^2/) , where ip G 

Case (b): l>2 and so J ^ The change of variables yi = z\,y' = 
in (1.8) leads to the a priori estimate: 

||bb)l|o<c{A^|OiV'b)A-'+ ^ 

+ lb'"^“V>l|oA^^}, 

|a+/3|<Z 

where 

y^=S -1(1-5)+ ai(l - 25) + (i - 5)\a' + /3'|, 

that is, 

l<|a+/3|</-l 

+ E Wz^D-iIjWoX^^} 

\a+P\<l 

for all pj G C^(R^), where a — {ai,a'), jS = (/3i,/3'). Evidently, the last term 
on the right-hand side of (1.9) tends to 0 as A ^ oo since S — 1{1 — S) < 0 
and Consider now the first term. We are looking for the negative powers 

of A. Put X = ^a(xo,^*^). Thus, a{xo,i^) — x(0^ . . . , 0; 1, 0, . . . , 0) and we 
conclude that if |a + /3| = 1, then on the corresponding right hand-side the term 
(1 — ix)di'ip{z) will participate. Thus 2<|a + /3|<Z — 1. Itis obvious that A will 
have a negative powers if: 

• l«'| + m > 2; 

• ai = 1 and |o;'| -h \(5\ > 0; 
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• ai — 0, \a' + P'\ = 1 , and (5 — | — (1 — S)l3i < 0. 

Again we will consider several caises. 

1 ) Assume that \a' + /3'\ = 1 , which implies |ai + ft| > 1 . Nonnegative 

powers of A can appear if ai = 0, /^i > 1 , and S — ^ — {1 — S)/3i > 0, 
that is, if 1 < /?i < But S < ^ there- 

fore the coefficients in front of these powers of A are vanishing. In fact, 
aAV,.^-a(a:„,O=0for/3i< 

2) Suppose now that \a' = 0 so that \ai -h/3i| > 2 . Nonnegative powers 

of A can appear if o^i == 0, > 2, /?2 < / — 1, and <5 — (1 — S)l3i > 0. But 

S < ^ Pi < jizjj < I < k, and = 0 for 0 < /?i < /c — 1. 

Letting A ^ oo in (1.9), we conclude that 

Iloilo < C||(l - ix)^i^||o for all i; G C^iR^. 

Since this inequality is violated for some -0 G C^{W^) (as we proved it above), 
our Theorem 1.4 is verified. □ 

Conclusion. The ^DO with symbol p\ — -h axi\^\, a ^ R^ , a ^ 0, and 
k ^N, is not subelliptic with loss of regularity 0 < (5 < 



Our next step is to find out all subelliptic operators among the ^DO having 
the principal symbol 

( 1 . 10 ) Pi = -h axj 1^1 with a ^ 0 . 



Proposition 1.6. An operator P with principal symbol (1.10) is subelliptic 
if and only if k is even, or if k is odd and a < 0. In both cases, the sharp loss of 
regularity of P is S = -j ^ . 

Proof. We will show that for each power 0 < 7 < , e(A) = A"'^, the 

following estimate holds: 

IIV’llo < + DA“ AT)y,(2;)j|^ 

+ A-^ ^ ||/Z)“V'l|o A-I“l^} 

\a+0\<N 



for all (x,^) G T*{K), |^| = 1, A > 1, and ip G C'^(E’^). The statement of the 
proposition will then follow from Theorem 1.3. 

One obtains immediately that 



\k+iT^^'^'^p^{x P y\ ^+i,^ + HA ^+1 )V^(?/) 






|a+/3|<fc 
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We will assume that |l^|io = 1 and , \a + (3\ < k\ 

otherwise the a priori estimate is trivially fulfilled. To prove the estimate, two 
separate cases will be considered, namely 

(I) \xi\>Mr-^, 

(II) \xi\<My>-T^, 



where the constant M ^ 1 will be determined later on. 
In case (I) we have A ^ '0 = where 



Ai'ip = di'i/j z^iA^+i 0 + axi\f^+^ 'll;, 






l<|a+ftl<* 



D°‘iP 



fc-fc|g|-/ 3 i 



kNi 



In order to estimate ||Ai0||o from below, we make the change 0 = 0i e , 

so ||0||o = 1101 llo) and we obtain 

Pi0||o 11^101 (y) +aa:iA^0i(^)||o > \a\\xi\^\T^. 

In fact, a simple integration by parts and the identity Re f 0]^9i0dy = 0 prove 
the previous inequality. On the other hand, there exist constants Ci, C 2 > 0 inde- 
pendent of M, 0, a such that 

l<\ct-\-f3i\<k 

<C 2 \a\ 

l<\oi+(3^\<k 

<C2|a||xJ|A^ Y 

l<W+(3i\<k 

< C 2 \a\\x\\ A^(^^ +0(1)^. 

The function o(l) ^ 0 for A 00 uniformly with respect to M. Therefore, taking 
C 2 M~^ < I we get 

||^iV> + BiiAllo > l|a| A'^^. 

In case (II) we now have A^T^p® 0 = ^20 + ^20, where 



^20 = A^+ii^i 0 + ^10 + a{yi + rciA^+i )^, 



B 2 tl) = a Y 



|a+ft|<fc,|Q|>l 



a\pn 



k-k\a\-l 3 i 



l«l=i 



A— Wr 
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In fact, 

a=0,0<l3i<k 

There are no difficulties to verify that 

IlSaV'llo < O E 

|a|>l,|o!+/3|<fc 

<CaM^ y] 

|o!|>l,|Q;+/3i|<fc 

and — > 0 as A +oo. 

In order to apply Theorem 1.3 we must show that 

(1.11) ||V'(y)llo < C\\diip{y) + ip{y)[i^i\^ + a{yi + a;iAm)'=]||^ 

for all xjj G where |Ci | E 1 and C = const > 0. To this end, we successively 

make the following changes: 

2/1 + Xi\T^ = Zi, tp{z) = , 

which reduce (1.11) to the a priori estimate 

||V'i(^)l|o < C\\dii}i{z) + az'^il)i{z)\\o, 

for all ijj G Cq^{W^), C — const > 0. This multidimensional estimate is an eatsy 
consequence of the one-dimensional estimate (1.12) that will be proved below. □ 



Lemma 1.7. The a priori estimate 

(1.12) 0011-0110 < \W{y) + a?/^0(2/)||o, Co = const > 0, a € R A 0, 

holds for each G if and only if 

(i) k is even; or 

(ii) k is odd and a < 0. 

Proof, (i) Let k be even. The change y —y reduces the case a < 0 to 

A 

dy 



the case a > 0. Having in mind the fact that ^ T ay^ is a linear operator with 



real- valued coefficients, we may assume that 'ip{y) is a real- valued function. Then, 
f ax^'ij;{x)) dx = ^if‘^{y) a f x^ {x) dx . (a > 0) 

J — oo ^ J — oo 

So, 

/I \ 

^/;(x)('0'(x) -h ax^'0(x)) dx > max f -^^(2/), a / x^'i/j^{x) dxL 

-00 J —00 ' 
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and evidently, 



(^' -h > max max'0^(?/), a J ijp' {x) . 

We rewrite the previous inequality in the following form 

1 

(1.13) 2(^' + > - max^^(?/) + u / x^ {x) dx . 

2 y 



If |x| > |, then 




ax^'ijj^{x) dx > a 




'ip‘^{x) dx, 



while for |a;| < we have 




dx < max'0^(rr). 

X 



Applying Cauchy’s inequality to the left-hand side of (1.13) and using the previous 
two inequalities, we get (1.12). 

(ii) Let k be odd and a < 0. Then, 




+ ax^'tl;{x))‘^ dx 



/ oo 
-oo 



+ a^x^^'ilP' - kax^ dx 



with —ka > 0 and k — 1 even. Consider now the cut-off function C ^ 
o<C<i, and C = 1 near 0. Thus -0 = + (1 — C)V^- According to the Poincare’s 

inequality: 

/ oo 

[{diipf +x^'^ilP'] dx, 

-OO 



since = 0 near a: == 0, and consequently, |^iC| < const for all x G R^. On 
the other hand, 

/ oo 

dx. 

-oo 

Finally, let k be odd and a > 0. As C^(R) is dense in the Schwartz space 
S'(R^), we have that the estimate (1.12) holds true for each ^ G S'(R). The function 

^ _ g-^f+r- ^ 5(R^) nker(^ -f ax^) violates (1.12). A detailed discussion for the 
case a > 0 and k odd is proposed below. □ 



To summarize our previous discussion, we now formulate the main result char- 
acterizing the subelliptic operators. 

Let p° = a ib, ord^p^ = m, he the principal symbol of some classical ^DO 
of order m. We assume a and h to be real- valued functions. We define 

Charp° = {(x,0 € \ 0 : p^(x,0 = O}. 
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The Hamiltonian vector field of the function a is defined as follows: 




The integral curve C of Ha passing through the characteristic point is 

called a zero hicharacteristic of Thus, 

C: X = V^a, ^ = -V^a; x(0) = Xo, ^(0) = C- 

Obviously, a\c = 0 and Hab{xo,C) = CW)|t=o- 

Theorem 1.8 ([El]). A classical P{x,D) with principal symbol p^ 

is subelliptic with sharp loss of regularity 0 < 5 < 1 if and only if, for each 
(x,^) G T*[K) \ 0, there exist j{x,^) G and 2 ; G \ {0} such that 

HL(zp-) =0 for 0<l<j-l, 

^0. 

If j{x,ff) is odd, then > 0, and moreover, 

sup j{x,0 = T^- 

{x,OGT*{K)\0 ^-0 

Remark 1.9. If p°{x,^) ^ 0, we put j{x,^) = 0. It is evident that the loss of 
regularity is J for some A: G N. 

Assume that the function (p{xi) from (1.1) is flat at 0, i.e., (/?^^^(0) = 0 for 
all I > 0, and assume that (f{xi) conserves its sign. Consider the symbol (1.10) 
with (p instead of ax^. Then subelliptic estimates with loss of regularity J < 1 are 
impossible. 

In the paper [Mz-Pa] the regularity of solutions of corresponding ^DO is 
studied in appropriate weighted Sobolev spaces. In many cases, these regularity 
results are optimal. 

Definition 1.10. A pseudodifferential operator P(x,D) is said to be locally 
solvable at the point Xq G H, if there exists a neighborhood uj 3 Xq such that for 
each / G C^(o;), one can find a compactly supported distribution u G S'{Q,) for 
which Pu = f in LJ. 

Definition 1.11. A pseudodifferential operator P{x, D) is called hypoelliptic, 
if for each open set a; C and for each distribution u G the assumption 

Pu G implies u G 

The following theorem on local nonsolvability is due to Nirenberg and Treves 
[N-Tre], and Egorov [El]. 
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Theorem 1.12. Consider a classical P{x^D) with principal symbol 

p^{x,^). Assume thatp{x^^^°) = 0, |^°| > 0, and suppose that there exists an 
odd integer k eN for which 

HLizpo) ^^{zp°){x,0 =0 for 0<l<k-l, 
for some z E \ {0}. Then, P is locally nonsolvahle at the point Xq- 



1.2. Local solvability and microlocal analysis. Keeping in mind the 
main theorems on subelliptic operators, we now consider the model boundary 
value problem (1.1) in the emergent case from the point of view of microlocal 
analysis. The study of a ^DO P with symbol i^i + (/?(xi)|^l == - i(/?(xi)|^|) 

could be simplified by applying the implicit function theorem on the closed cone 
r = {161 < 6161 : 6 = (6> • • • >6)}- In fact, = 6 - «<^(a;i)|^| is elliptic outside 
of r. So we have that in F the variable satisfies 6 = which implies 

6 = ±i>f{xi)\^'\l + <p^{xi), and so 



6 -*(p(a;i)|^| = 



' . <p(a^i)l6l 

. ^ yjl + <p2(xi) 



h 



with ord^ h — Q and h|r ^ 0. In this way, we have reduced the study of our initial 
^DO with principal symbol p^ to the investigation of a ^DO with principal symbol 
— i'0(xi)|^'| where '0(xi) = ax^ + 0(|xi|^+^) as xi ^ 0. 

We now study the kernel of the operator Q = D\ — iip{xi)\D'\ in the cone F, 
when k is odd and a > 0. One can easily see that ^ + il){xi)\^'\u — 0 implies 

u{xux',Q) = [ [ 

where v{y') = u{0,y',0) and B{xi) = 'ip{s)ds. Consider the kernel K of that 
FIO with complex- valued phase: 

Kv{x)^ [ [ x G M^. 

Then K : Cq^{MA~^) and K : are continuous, and 

QKv = 0. Denote by 7 the mapping 7(x') = (0, x') for all x' E Certainly, 

its adjoint 7* is the restriction to the hyperplane x\ = 0. Obviously, 

rKv{x) = Kv\,,=o = f e“'«'fi(6) d^' = v{x') € S'. 

The phase function of K is $(xi, x', y'; ^1, 77 ') = {x' — y')^' -\-iB{xi)\^'\, > 0, 

B >0. According to Theorem 8.1.9 from [H2, Vol. I] 

WF{K) = {{xi,x',y'-,^i,^',v'); {Si,e,v') = K,y, i.e., 

WF{K) = {(0, 6, a:'; 0, 6,-0, + 0|- 
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Evidently, W F' {K)\^n-i — {{y',rj') : {x,y' ,0, —rj') G WF{K)} = 0 , and therefore 
Theorem 8.2.13 from [H 2 , Vol. I] gives us: 

WF{Kv) = WF\K)WF{v), where 

WF'{K) = {{Q,x',x'-Q,i',0, ^VO}. 



In other words, 

WF(Kv) C {(x,0; {x,y';^,rj') G WF\K) for some (^',77') G WF{v)}. 

Assume that F 0 is a closed conic subset of {(xi = 0 ,x';^i = 0 ,^'), 7 ^ 0} 

and WF{v) — F. The relation (1.14) implies 



WF{Kv) = {(xi - 0,x';6 = 0,e'); ^ F}. 

The last fact shows that the operator Q is not hypoelliptic and consequently is non- 
subelliptic {QKv = 0, sing suppF^; 7 ^ 0 ). Moreover, dimkerQ = 00 . The adjoint 
operator P* of P has the principal symbol — + ^(xi)|<^| = —^(^1 + i(/p(xi)|^|), 
where <^{xi) = ax\ with k odd, a > 0. As we proved in Proposition 1.6, P* and 
the corresponding operator Q* = + z'0(rri)|P'| are both hypoelliptic. Then by 

Theorem 1.12 we can conclude that P* and Q* are both locally nonsolvable. 
Consider now the equation Q*w = f, we Then, 

K*Q^w = K*f => {QKfw - K*f ^ K*f = 0. 

We explain this way the local nonsolvability of the operator Q* with the exis- 
tence of infinitely many compatibility conditions imposed on the right-hand side 
/, namely K*f = 0. In order to avoid that kerQ be infinite dimensional, we 
prescribe an extra condition on the hyperplane {xi == 0 }: 

Qw = ge S'{R^) 

w\xr=0 = 0 . 



‘ dx[dy'd^'. 

Jo 

The last FIO with B{xi,x[) — 'ip(s) ds is of subelliptic type with loss of 
regularity We omit the proof. 

To complete the study of the boundary value problem (1.1), we will estimate 
the norm assuming that its trace c(x) = u(x,0) on the boundary 



(1.15) 

Then, 



w(x) = [ 
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satisfies a subelliptic ^DO. Thus, 

= / / \u{^,Xn+l)\'^ d^dx. 

J J 0 



U 



n+1 



= / |c(OI^(/ e 

JR-^ 1^0 j 

<c [ |^|-'|c(0l^rfe 

JR^ 

^ C'||c||^_l/2(Jf^r^) < Cl{\\g\\‘^^_^^^_^ + lkll//-l(Rr^)). 

There are no technical difficulties in verifying the estimate 

3 



which follows from the Sobolev trace theorem ||c|lj:/s-i/2(]i^n) < C|fy||^s(]i^«+i) for 

s > |. So we conclude that, if G (W^) and u G for 

some fixed So > |, 5 > 5o, then the solution u of (1.1) belongs to the space 
H^{xn-\-i > 0) n (7®°(xn+i > 0) (regularity result). 

In the case when Q is nonhypoelliptic one can similarly get the a priori estimate 






(K 



flN < C. 



(llfl'll^.-l/2-^ 



(M^ 






,) for. >5, 



where uq is the extra condition prescribed on = Xi =0}. In conclusion, we 

have an estimate for the solution u of the following modified tangential oblique 
derivative problem with an emergent vector field 1 : 



{ Au == 0 in Xn+i > 0, 

^ = g{x) on x„+i = 0 

«Ui=o = uo{x'), x' = (x2,. . . uo € 



We point out that uq is given on the set of tangency of the vector field I to the 
boundary {xi = Xn-^i =0}. 

Combining the previous considerations we come to the conclusion that the 
Cauchy problem: Q{xi,D)u — 'yu — v{x'), where 7 is the trace operator on 
{xi = 0} and x = (xi,x') G has the solution 



u{xi,C) = e 

Jo 



where — i^i + '0(a:i)|^'|, 'ip(xi) — ax^ + 0 {x^'^^) as x\ 0 , k odd, a > 0, and 
B{xi,x'i) = ds. Certainly, u is the unique solution of the ODE 



dgg^u^-'il)[xi)\i'\u = g{xi,^'), w(0,C') = u(^')* 
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Moreover, B{xi^x[) > 0 since either 0 < < xi or 0 > x[ > Xi. Thus, 

u{xi , x') = Kv{x) + Eg 



with 



Kv{x)= f [ 

Eg{x)= r [ [ 

Jo Jr^i-i 



Jo JR^- 

One can easily see that 

'Q 



Id 0 



Ml- 

In fact, QE = Id^ QK = 0, ^E = 0, = Id. Similar calculations show that 

(E,K) = EQ + Ky = Id. 



The proof of the identity EQu-\-K^u = u is left to the reader. The trace operator 7 
maps C^{W^) and therefore its adjoint 7 * is given by the formula 

^*v{x) = v{x') S{xi) for all v G C^{W^~^). To clarify the main idea, our 
considerations will be rather formal. Put 

M : w (?r) • © C^(R^r^). 



We equip all these spaces with L 2 norms and scalar product (*,•), and we look for 
the adjoint operator M*. Let {u,v) G C^(R^) 0 C'^(E^~^), w G C^(W^), Then, 

(M*{u,v),w) = {{u,v),Mw) == {{u,v),{Qw,'yw)) {u,Qw) + {v,^w) 

— w) + ( 7 *n, w) = {Q*u + n 0 (5(xi), ic), 

that is, M*{u{x),v(x')) = Q*u + v{x')(S)S{xi). Since (E^K) is a left inverse of M, 
we get M*{E, K)* = Id^ and so 

{Q* J(xi)) (Jh = Id. 



Therefore, the operator M* is locally solvable near 0 and the solution is uniquely 
determined. 



Conclusion. Consider the operator 

Q* = -a,, +^(xi)|D'|, 

where '^(xi) == ax\ + 0(|xi|^+^) with a > 0 and k odd. This operator is locally 
nonsolvable near the origin. However, the following modified problem 

Q*u{x) + v{x’) 0 (5(xi) = g{x) 

is locally solvable nearO for any given function g , and the solution {u,v) is uniquely 
determined by g. 
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Remark 1.13. Let Q* = —dx^ + ^(rri)|D'|, '0(rri) = ax\ with a > 0 and k 
odd, and let ^ C be a neighborhood of {xi = 0}. Then one can find a constant 
(7 > 0 such that 

||{'i^}xi=o||L2(M^-i) + ||^||L2(IRr.) < C\\Q*U + {lt}xi=0 (^(^l)llL2(Mn) 

for each function u G H^{W^ \ {xi = 0}) having compact support in 0. As usual, 
denotes the jump of u on {xi = 0}, i.e., 

{M}a:i =0 = w(+0, x') - u(~0, x') G 

Note that by the Sobolev trace theorem, ii(±0,a:') € 

We will prove the a priori estimate stated above in the 1-dimensional case. 
The proof in for n > 2 follows immediately from Consider L = dt 
with A < 0 and k odd. Let u± G ^ 0 ( 1 ^^), where = {t : t > (<)0}. Then, for 
some constant Ci > 0: 

|u±(±0)p + ||w±||i2(R^) < ci||Lm±||£,2(r^). 

In fact, a simple integration by part shows that for u G C'o(K+), we have 



Re(Lw,at«-«)L2(R+) 

> lklli2(R^) - A|||tl^n|U2(R^) + iK+0)|2 

> Jk+ 0)P +C2(||n||i2(R^) + ||n*||i2(R^) + (-A)|||t|U|U.(R^)), 

where C 2 is a constant independent of A. The Cauchy-Schwartz inequality, applied 
to the left-hand side, gives us the inequality we are looking for. The well-known 
jump formula (see [Pa]), 

dtu = dtu\t^Q + {u}t^o 0 St 

for u G Co(M+) n Co(M_) with dtU G P'(R^), completes the proof of our a priori 
estimate: 

|{lt}t=o| + ||'^||l2(M) < C\\Lu — {u}t=o 0 <^t||L2(E)* 

Summary. We now summarize the local properties of the tangential oblique 
derivative problem for Laplace operator (1.1). 

Case I: I is a neutral vector field (see Figure 1). Then the bvp (1.1) is locally 
solvable, i.e., for each g G s > 1/2, there exists a solution u G 

of (1.1). Moreover, g G (7°^(IR^) implies u G C'^(M!^"^^). In fact, the 
trace c{x) = u{x,0) on the boundary satisfies a subelliptic ^DO with principal 
symbol |^| with k even, k ^ 0. 

Case II: I is a vector field of emergent type. Then the bvp (1.1) has a kernel 
of infinite dimensions. In order to avoid this difficulty, we modify (1.1) by putting 
an extra condition uq on the tangency set {xi = Xn+i = 0}. The modified problem 
(1.16) is locally solvable, and for each g G (R^), uq G (E^“^), 
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5 > 3/2, there exists a solution u e of (1.16). There are at most finitely 

many solutions. In fact, the trace c{x) = u{x, 0) satisfies a non-subelliptic equation 
with principal symbol of the form + 'ip{xi)\^'\ with 'ip{xi) = ax\ + 0(\x\\^^^) 
asxi^O, a>0, and k odd. Then we consider the following Cauchy problem: 
Q(x,D)c = g, c\x^=o = uq{x') which locally has a unique solution c. 



Case III: I is a vector field of submergent type. The bvp (1-1) is in general 
locally nonsolvable. In fact, the trace c{x) is the solution of a locally nonsolvable 
subelliptic ^DO on the boundary with principal symbol + iaxi\^\ with a > 
0 and k odd. It is interesting to note that the boundary value problem under 
consideration remains hypoelliptic, i.e., if u G So > 3/2, is a solution 

of (1.1) for g e C^(M^), then u e C^(R^). 

In the case of a submergent vector field Z, we can replace the tangential oblique 
derivative problem (1.1) with the following modified problem: 



(I.IM) 



Au = 0 in Xn+i > 0 
3u 

— - v{x') ® <S(rri) = g{x) on {x^+i = 0}. 



Not only u is an unknown function but v as well. We can expect the existence 
(even locally) of a solution {u{x) , v{x')) of the bvp (I.IM). 



Remark 1.14. Assume that we are looking for a solution u G C^{xn +1>0) 
of the bvp (1.1), the submergent case, such that u belongs to \ {^i — 0}) 

and has a finite jump discontinuity on {x\ = ^n+i = 0}- From the Schwartz 
distribution theory it is well known that on { 2:^+1 = 0}, 



du 

dxi 




+ {^^}xi=o (8)(^(a:i), 



where == u(+0, x', 0) — u(— 0, x', 0). Therefore, the bvp (1.1) takes the form 

Au = 0 in Xn+i > 0 
du 

= g{x') on o;„+i = 0, 

in other words, it is of type (I.IM) with v = {u}x^z=o- We can expect (possibly 
under additional assumptions) that the bvp (I.IM) is not only solvable but that 
u(x') = {ri}cci=o- Therefore, we can hope that ‘in general’ the solution u of (1.1) 
will have a jump discontinuity on {xi = Xn+i — 0} which is uniquely determined 
by g. The solution u of (I.IM) could be a classical one if v{x') = 0, which implies 
the over determination of the bvp (1.1) in the submergent case. The lack of classical 
solutions for a ‘massive’ set of right-hand sides g is due to the last observation. 



1.3. Canonical transformations. Subellipticity is invariant under homo- 
geneous canonical transformations and under multiplication by zero order elliptic 
^DO, see [El], [H2, Vol. IV]. For the sake of completeness, we will remind the 
reader of the corresponding definitions and theorems. 
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A symplectic form cr on a smooth manifold M, dimM = 2n, is by definition 
a closed nondegenerate differential two- form on M. Assume that M = T*(ri) is 
the cotangent bundle over the smooth manifold dimO = n. Then, M can be 
equipped with a symplectic form in a standard way. In fact, in local coordinates 
(x,f) G a symplectic form is given by: 

n 

a = A dx = ^ d^j A dxj . 

This definition is actually independent of the choice of local coordinates. 

Definition 1.15. A smooth mapping x from Mi c T*(Q) to M2 C T *{ Q ) 
is called canonical, if it preserves the symplectic form on T*(0). In other words, 
X : Ml M2 is canonical if and only if x*cr = cf- 



Consider now the transformation defined by the real-valued generating func- 
tion S{x,rj) e dS — {i,dx) -h {y,dr]), where det5^'^^ ^ 0. In coordinate form 
we have 

fiQ 

(1.17) = !<,<n, 

i.e., locally, rjj = r]j{x,(,) => yj = yj{x,(,). We will prove that (1.17) gives a 
canonical transformation. In fact, the identity 



d{{y,v) - S) = {y,drj) + {r],dy) - dS = ~{^,dx) + {r],dy} 

implies 0 = d?{{y, rj) — S) = —d^ Adx + dr] A dy, and so d^ Adx = drj A dy. 

The canonical transformation (1.17) is called homogeneous if S{x,rj) is posi- 
tively homogeneous of order 1 with respect to 77, i.e., ord^^ 5=1. Then, certainly, 
ord^y = 0 and ord^ 77 = 1. We now define the Poisson bracket of two smooth 
real- valued functions on T*(fi): 



{f,g} = 

J = 1 



\dxj d^j 



d^j dxj ) 



It is well known that a mapping x • T*{Q) T*(Q), Q C is canonical if and 

only if it preserves the Poisson bracket of every two functions. The last assertion 
can be proved by the reader. 



Definition 1.16. Consider a smooth real-valued function S { x ,^) such that 
ord^5(x,^) = 1, and assume that |Vx5(a:,(^)| > Ci|^| for |^| > C2, where Ci, C 2 
are some positive constants. Then, S{x,^) is said to be a phase function. We will 
assume, moreover, that det 5^' ^ / 0. 

The corresponding FIO with phase function 5 is defined as follows: 

^u{x)= f a{x,^)u{^)e^^^^'^'> d^ for m e 

JRri 

where a(x,^) G C°°(IR^ x (M^ \ 0)), ord^ a = 0. 

The following theorem is a famous result due to Egorov [El]. 
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Theorem 1.17. Suppose that P{x,D) is a classical of order m, and 

suppose that the symbols p of P and a of ^ vanish outside some compact K 
Then there exists a classical Q of order m with the following properties: 

(i) The order of the operator P^ — is —oo 

(ii) The principal symbols p° of P and of Q are linked by the equality 

= q°{y,'n), 

where ^,y are given by the homogeneous canonical transformation (1.17). 



A simple application of Theorem 1.17 is proposed below. 

Let p^{x, be a real- valued classical symbol such that ord^ p^ = l,p°{xo, = 
0 for ^ 0, and 7 ^ 0. Without loss of generality we assume that 

7 ^ 0, and consider the following Cauchy problem: 

p°{x,\ 7 j:S{x,r])) = 771 , 



(1.18) 



^ ', {^3 ^jo)- 

i=2 



In a neighborhood of (xo,C°), there exists a smooth solution S{x,r]) of (1.18), and 
one can check that S{x^tr]) = tS{x,rj) for every ^ > 0, \VxS{x,r])\ > C\r]\ for some 
constant C, and det 7 ^ 0 . 



Conclusion. In each microlocal investigation near a characteristic point, say 
(xo,$^), we can work with a ^DO having the symbol rji instead of p° . That is, we 
can work with the operator D\ — Suppose now that the classical complex- 

valued symbol r® = P^(^,C) + iq°{x,f) satisfies the conditions r^{xo,ff) = 0 and 
V^p^(xo,^°) 7 ^ 0. Then there exists a homogeneous canonical change with gener- 
ating function S defined by (1.18), which on a conical neighborhood of (xq,$^), 
microlocally transforms into r^ — r]i iq^iy^r]) with ord^ q^ = 1. 

Since the subelliptic estimates (1.4) and (1.5) are invariant under canonical 
transformations, in all our microlocal subelliptic investigations we can deal with 
the symbol -\-ia{x,(f) for real-valued a{x, ^), ord^ a — 1, and even with the symbol 
+ ia{x,(^') where = (^ 2 , • • • jfn)* A 5 we mentioned before, this very important 
contribution is due to Egorov. 



1.4. The Calderon projector. In this section we will discuss some aspects 
of the Calderon projector. Let Q be a bounded domain in with smooth 

boundary dQ,, and let Cl lie on one side of dCl. Let ^ be a neighborhood of dCt. We 
identify PnCl with the product 5Q x [ 0 , ^], s > 0 , by introducing local coordinates 
X — {xi,. . . ,Xn) in dCl C and taking a geodesic normal coordinate with 
respect to dCl. Thus the points in T have the form {x, x^+i) with 0 < Xn-^i < £. 

We consider the second order differential operator 

n+l n+1 

L= T. 0‘ij{y)didj + a,{y)dj + ao{y), 

i,J = l j = l 
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where y = (yi, . . . ,yn,?/n+i) ^ aij{y) = aji{y), and for 

some constant c > 0 and for ally e 0., ^ G We assume all the coefficients of 

L to be smooth real- valued functions. Moreover, we will assume that ao(y) < 0 

everywhere in In the neighborhood the operator L can be written as: 

2 

L = '^SjL2-j(x,Xn+udx)di^^^, 

where the Lk are linear differential operators of order k on the boundary dQ, 
eo = 1, 6i = 2, and S 2 — 1. 

Let I be a nonvanishing smooth real- valued vector field on dQ, and let h G 
C^{dQ.) be a real- valued function. We will call the boundary value problem 



(1.19) 



Lu — F in 
du 

hu = f on dQ., 



an oblique derivative problem. 

Denote by r a smooth real- valued vector field tangential to dQ. and such that 
I = r an. As usual, n stands for the unit exterior normal vector field to dQ. 
Without loss of generality we assume |/| = 1; evidently a — (/,n) G C^{dft). In 
our local coordinates Q = > 0}, dQ = =0}, we have 



d 

dn 



d 

dXn+l 



and 



dr 



n 

'^aj(x)dj. 



The unique solution of the Dirichlet problem Lu — F in Q, u — 0 on dQ will 
be denoted by RF, while the unique solution of the Dirichlet problem Lu = 0 
in D, u = / on dQ will be denoted by 5/. The solutions are unique due to the 
maximum principle {uq < 0). Obviously, 5/|an = / implies ^(S'/)|ao = fy. 

Let us make now the change ui = u — RF in (1.19). In this way, we get 

Lui =0 in Q, 

(1.20) Qui / d \ 

^ = / - 7(^ + h)RF on dQ, 

where 7 : G C^{Q) vu\q^ is the trace operator. 

Put ui = Sv, where v is an unknown function on dQ, and let 

Using this notation, one obtains immediately that F a-^ F h)Sv = fi on 
and so f hv — fi on dQ. The operator just obtained, 

(1.21) A : 1 -^ ^ — ay-jT-^ — SvFhv, iorveC^ldQ), 

dr dxn+i 



is a classical ^DO on dQ. 
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Definition 1.18. The operator A defined by (1.21) is called a Calderon op- 
erator of the bvp (1.19). 



Conclusion. The solvability and regularity properties of the oblique derivative 
problem (1.19) are reduced to the investigation of the solvability and regularity of 
the Calderon operator A on the boundary dO,. 



For simplicity, we will show that A is a ^DO in the special case when the 
coefficients of L do not depend on (x,Xn+i) and each operator Lj is homogeneous 
of order j. Having in mind that L is an elliptic operator with symbol 

-(L2(e+2Li(een+i+j^o(m'+i), 

we have that Tq(^) = const ^ 0, and I/o(<^)I/ 2 (^) — Tf(0 > 0 for ^ ^ 0. 

A partial Fourier transformation with respect to x in (1.20) leads to the fol- 
lowing ordinary differential operator depending on the parameter 

L2(0m - 2lLi{^)dn+lU + = 0, U = u{^,Xn+l), 

and therefore, 

where Ai ,2 = ReAi < 0, ReAj > 0. 

Suppose that Lq > 0. Thus Ai = -^i(0 = obvi- 

ously we must take d{^) = 0, which implies u(x, 0) = c{x) and 

u(x,x„+i) = I 

Then, 

— u=- /'e“^a(x)Ai(Oc(Od?- 

OXn-^l J 

Since Li is a first order differential operator, we have 



L\ {dx) = ^ bj {x)dj — i ^ bjDj , iDj = dj . 

j=l 3=1 

We conclude that the symbol of the Calderon operator A is given by 



i 



^ (aj{x) 

j = l 



Lq ) Lq 



Through more complicated calculations, one can show that the same formula for 
the principal symbol Ao of the Calderon operator also holds in the case of variable 
coefficients. Indeed, 



( 1 . 22 ) Ao{x,i) =if2,[o.j{x) - 

with Lq{x) > 0, (x,^) G T*{dLt) \ 0. 



yLo(x)L2(x,0 - Ll(x,J) 
Lq{x) 
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If n > 2, it is obvious that Aq{x^ / 0 for ^ ^ 0 if and only if a{x) = (/, n) ^ 0. 
We will say that (1.19) satisfies the Shapiro-Lopatinskij condition if Aq{x,^) ^ 0 
for every ^ ^ 0. Therefore, the oblique derivative problem (1.22) satisfies the 
Shapiro-Lopatinskij condition if and only if the vector field I is not tangential to 
at any point x G dO.. This condition is violated at each point x G dft at which 
l{x) becomes tangential to Oil. We assume that r ^ 0 at such points. 

1.5. Holder regularity. We will complete Section 1 by formulating several 
results about the solvability of the bvp (1.1) in Holder classes and about the 
behavior of subelliptic ^DO in Holder spaces. We remind the reader that zero- 
order classical ^DO continuously map each Holder class into itself (cf. [Mey]). 

We begin by recalling the definition and some properties of the Holder spaces 
Aa(i^n)^ They coincide with C^+^(E^) for a = k-\-/3, k ^ 0 < /3 < 1. However, 

the definition of is quite different. 

Definition 1.19 ([St]). Let 0 < a < 2. Then a function / belongs to A‘^(M’^) 
if and only if / G L°^(R’^), and 

^(^) = ll/(^ + t) + f{x -t)- 2/(a:)||i,oo(jR.) < A \t\^ 
for some constant A > 0. 

The corresponding norm is defined by 

|/|q = ||/||i,~(R") + sup T^\\f{x + 0 + fix -t)~ 2/(a:)||i<x.(K„). 
iti>o m 

It is well known (see [St]) that for o; ^ 1, A'^(M’^) coincides with C'^"^^(M”) for 
/c = 0, 1; and 0 < (3 < 1. Moreover, the norms in these spaces are equivalent. On the 
other hand, A^(M’^) D C^(M”), and there exists a function / G L^(W^) n A^(M^) 
such that / 0 As usual, stands for the set of smooth functions having 
Lipschitz continuous k-th. order derivatives. Moreover, for o; > 1, / G A‘^(M’^) if 
and only if V/ G A"“^(M’^). The space A^(M’^) is called Zygmund space. 

We will consider the bvp (1.1), only in the case of a neutral vector field /. 
According to the result of Section 1.2, we have the equation 

^^+^|;(xMu = 9ixua, 

where ^p{xl) = axi+0{\xi\^~^^) as > 0, a > 0, and k even. Setting B{xi,x[) = 
/^? V^(s) ds, we get 

fi(xi,^',0)- [ so 

J-l/2 

(1.23) v{x)^u{x,0)^ [ [ 

J^n-l J-l/2 

if supper c {l^il < The term does not participate in (1.23) 

because v{x) is a tempered distribution. 
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The kernel K of the FIO (1.23) is given by the formula 

K{xi,x\-x',y')= f so 



(1.23A) v{x) = ( K{xi,x[-,x' ,y')g(x\,y')dx\dy' . 

A change of variables yields 

K{xux\\x' ,y') = f [ 

J\^'\ = l Jo 

and a standard regularization of K for x[ < X\ implies 



(1.24) 
where Cn 



K{xi,x[-,x',y') = Cn [ 

Jw\=i {i{x' - y')^’ - B{xi,x[)) 

const ^ 0. There are no difficulties to verify that 









1^1 < C ^ 

{\x' - y'\ + B{xi,x\)) 

forn > 2 and some constant C > 0. After long computations based on this estimate 
of A, we arrive at the following Lemma. 



Lemma 1.20. The integral operator defined by (1.23A) acts continuously from 
the space A“q^p(R’^) into Aco'lnp'^^ (R’^) for o; > 0. 

The proof of this lemma can be found in [Gu] (see also [p-pi]). 

Going back to the problem (1.1) in the case I {I of neutral type), we can 
construct a local solution of (1.1) near xi == 0 having the following properties: 
If p G 0 < ^ ^ N, then u G C^'^(^({x^+i > 0}) n C^({xn+i > 0}), 
0 + ^ result is more precise in Zygmund spaces, namely, g ^ hP for 

/3 > 0 implies that u G A^^^ {{xn+i > 0}) Pi C^{{xn^i > 0}). 

It is interesting to note that subelliptic estimates in Holder spaces do not hold 
in general for differential and pseudodifferential operators that are subelliptic in 
Sobolev spaces. In the framework of Guan [Gu], we will give below an example of a 
boundary value problem that is subelliptic in Sobolev classes but is not subelliptic 
in Holder spaces. We consider the bvp in R!J:“^\ n > 2, 



(1.25) 



Au = 0 in {xn+i > 0}, 

du . , du , 

+ + o„K«=0). 



Here a G (0, 1) is a constant, (f{xi) = ax^, a>0, ugR, /c>2 even. Certainly, 
the Shapiro-Lopatinskij condition is violated on the set {xi = = 0}. 
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Proceeding in the same way as in the investigation of (1.1), we obtain a ^DO 
for the trace u{x,0) = c{x). The principal symbol of the corresponding operator 
is (up to a factor i): 

Qi =6 -a|?l 

and Chargf = {(a:, 4) : , x\ = 0}. Since q° is microlocally elliptic 

outside of the conical surface = a|^|, we can apply to q° = Q the implicit 
function theorem in a conical neighborhood P of {^i = o;|^|}. Therefore, the study 
of the bvp (1.25) can be reduced to the investigation of a ^DO with the symbol 



Pi 



6 - le'i 



a — iip(xi) 

y/1 - {a-iif{xi)y' 



e' 



(^2 ? • • • ? ^n) • 



The zero bicharacteristics of Re are given by the formula: 



C : 



xi{t) = t(l - a^), Xj{t) = Xjo - for 2 < j < n, 

m = Ci = c^\n ^? = o. 



Thus lmq°\c = at^{l — according to Theorem 1.8, q\ is a first-order 

subelliptic ^DO with sharp loss of regularity We will show this result does 
not hold in Holder classes. We point out that canonical transformations cannot be 
applied in A®, s > 0. 

We write 






= a{xi) + ib{xi) 



>/l - (a - i^{xi)Y 
with real- valued functions a{xi) and b{xi). These functions are 
neighborhood of the origin. Simple calculations yield: 



smooth in a 



a{xi) 






: + and b{xi) = — 



ip{xi) 



(l-a2)3/2 



+ o((^^) 



near xi = 0. Thus Pi = — |^'|d(a:i) with d(xi) = a{xi) + ib{xi), and we will 

study the ^DO 

{Di - \D'\d{xi))c{x) = gi{x) 

for some gi. Making a partial Fourier transformation with respect to x' in the 
equation above we get 



dx^c{xi,C) -i\^'\d{xi)c = igi. 



The change xi —xi gives us: 

dx^c{xi,^') + i\^'\d{xi)c = -igi. 

For simplicity, we have written the same functions c, d, and gi instead of the 
corresponding c(— xi,^'), etc. Then, 



J — OO 



where D{xi,x[) = d{6)d0, suppgi C {|a;i| < i}. 
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1 da'c. 

n—l q 



Evidently, Re(— x'l)) = b(6)d0 < 0 near 0, as x[ < Xi and k is even. 

It follows immediately that 

c{x) = -i[ r ( 

J^n-1 jRri-1 

The FIO just obtained has the kernel 

jR-ri-l 

which, as it was shown in (1.24), can be rewritten in the form 

(1.26) K{xi,x[;x',y')=Cr^ f — ^ — 

•^l«'l=i ((a:' - y')^' - D{xi,x[)) 

To clarify the calculations assume n = 3, i.e., n — 1 = 2. After a polar change in 
(1.26) one obtains: 

K{xux[-,x',y')=C',- 

{D‘^{xi,x[) - \x' - y'P) ' 

for some constant C 3 7 ^ 0 . 

Instead of g\ we consider the functions gif^ = u){x)x^h^^‘^\h\~^~^^ ^ where 
h{x) = D^( 0 ,xi) — G (7^ near the origin, lo G C^{W^) with a; = 1 in a small 
neighborhood of 0, A: > 4, and (3 G [0, 1] such that 1//3 is an odd integer. We can 

1 /2— ^ 

see that pi/3 G Acomp^”^^- Obviously, 

c/ 3 =[ [ K{xi,x[;x',y')gi) 3 {x[,y')dx[dy'. 

J —00 



Proposition 1.21. Suppose that A: > 4 Z 5 an even integer. Then: 

(i) The trace cp on {x^+i = 0} of the solution u of the bvp (1.25) with 
right-hand side gip satisfies in a neighborhood of the origin the pointwise 
estimates 

lci(x)| < const I In |xl|, \cp{x)\ < const \xf~^ for (3 G [0, 1). 

(ii) The trace ci of the solution u of the problem (1.25) with right-hand side 
gii satisfies in a neighborhood of the origin the lower estimate 

|ci(a:i, 0 )l > const | In fyi||. 



This proposition is proved in [P-Sou] (see also [p-pi]). 



Remark 1.22. Obviously, 

T)^(0, xi) — fy'p = h^x\ — \x'\^ T ib\x\'^‘^ + 0{xf^^‘^) as a:i 0, 

where 60 > 0 and b\ / 0. Consequently, sing supp^i^ = {xi = 0} for 0 < < 1, 

and sing supppii = {0}. Having in mind the hypoellipticity of P, we have that 
Cl G C'^(M^ \ 0), while cp G C^{R^ \ {xi = 0}) ^ov 0 < p < 1. 
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Conclusion. Consider the bvp (1.25) for n = 3, k > A, k even, and with 
boundary data gu. Then the corresponding solution u belongs to (n \0), and 
it blows up logarithmically near the origin. The operator P is not subelliptic in the 
Holder classes since Pc G implies c ^ and C for all 5 > 0. 

Concluding remark 1.23. The natural way of proving the existence, unique- 
ness and Fredholmness of the tangential oblique derivative problem (0.1) is the 
method of a priori estimates in Sobolev spaces. To do this we localize the problem 
in inner subdomains and in one-side neighborhoods of the boundary points of Q by 
means of a partition of unity. On each neighborhood of a boundary point on which 
the Shapiro- Lopatinskij condition holds, there are well-known a priori estimates. 
Therefore, these neighborhoods comprising parts of the set (manifold) E of tan- 
gency of the vector field I to the boundary, are the most interesting to us. In fact, 
the Shapiro- Lopatinskij condition is violated at E. As the order of tangency of I to 

is invariant under smooth change of variables, we can concentrate our atten- 
tion in a local straightening of the boundary and consider the oblique derivative 
problem in the half space. The main difficulties lay there. After reducing our bvp 
to the boundary, the famous subelliptic estimates play an important role there. 
For this reason, in the first section of this paper we decided to present a more 
detailed analysis (including calculus) of the oblique derivative problem in the half 
space. Thus, in a natural way, we arrived at a different statement of the problem 
in question depending on the structure of the boundary vector field around the 
points of tangency. More precisely, we considered vector fields of neutral, emergent 
and submergent types. At least in the case of some instructive model examples, 
we constructed parametrices of the bvp (1.1) and (1.16). We also concluded that, 
depending on the type of boundary vector field, there were three fundamentally 
different possible cases: bvp of Fredholm type, bvp having an infinite dimensional 
kernel, and bvp having an infinite dimensional cokernel. Relatively simple consid- 
erations in the latter two cases enabled us to modify the corresponding bvp in 
order to obtain bvp of Fredholm type again: (1.16), (I.IM). 

Since we have proved local existence theorems (though in model examples) , it 
was only natural to estimate appropriate Sobolev norms of the solutions. In this 
way, we got to the subelliptic estimates of Hormander- Egorov- Nirenberg-Tr eves. 
Their rather technical proofs are carried out through the method of localization 
(see [El], [H2]). Having in mind the purpose of this paper, we preferred to illus- 
trate the localization method mentioned above by means of model examples arising 
in the tangential oblique derivative problem in the half space (1.1). Through our 
discussions in Section 1 we hope to have introduced the reader into the theory of 
the tangential oblique derivative problem for the Laplace equation. 

The study of the same problem, but in the case of an arbitrary bounded domain 
with smooth boundary, is very technical and requires a priori estimates for ^DO 
in (weighted) Sobolev spaces and, of course, it needs an appropriate partition of 
unity. This procedure has been developed in detail in many papers (see also the 
monographs [Pa] and [El]). Once again, depending on the structure of the vector 
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field I at the boundary (neutral, emergent, submergent), we will have a bvp (0.1) of 
Fredholm type, with an infinite dimensional kernel, or with an infinite dimensional 
cokernel. The detailed proofs in that situation go beyond the frames of our survey. 

We hope that the reader getting acquainted with the methods of study in 
Section 1, will take for granted the general results presented in Section 2, and will 
look for their complete proofs in the papers [Mz-Pa], [Mz-Pal], [Mz], [Gu], and 
in the loc. cit. monographs. 



2. Survey on the degenerate oblique derivative problem 
in Holder, Sobolev, and Besov spaces 

During his investigations on the tides in the oceans the famous French Math- 
ematician Henri Poincare [Poi] considered the following boundary problem 

(2.1) Pu = f in a domain C lu — g on dO, 

where P is an elliptic second order differential operator, and I is a real-valued 
non-degenerate vector field on the smooth boundary dCl. The problem (2.1) differs 
from the classical Neumann problem (/ = ^ with n being the unit outward normal 
vector field to dQ) as I may be tangential to dCl at some points. 

The investigations from Section 1 show that the oblique derivative problem 
(2.1) may have an infinite dimensional kernel or cokernel, if I contacts the boundary 
dQ. At first Bicadze [Bi] obtained several interesting results in the case of emergent 
and submergent vector fields on a ball. A classification of the vector fields I in the 
tangential case, and some a priori estimates in a special case, were proposed by 
Borrelly [Bo] who had in mind the theory of Brownian motion. We introduced 
and used this terminology at the beginning of the previous section under the 
assumption that dCl = {xn+i = 0}. 

As we mentioned before, the Shapiro-Lopatinskij condition is satisfied in the 
case when I is not tangential to the boundary <90, and it is violated at the points 
where I is tangential to ^0 for n > 3. 

To formulate the first result of this section, we define the elliptic operator 

n n 

P = 'P, + ^bi{x)di + c{x) 

i,j=l i=l 

with coefficients in C^(0) for 0 < o; < 1, and 

n 

’Y] aij{x)^iij > col^p for all ^ G K”, 

where cq > 0 is a constant, and aij{x) = aji{x). We assume the domain 0 to be 
bounded with boundary ^0. We also assume the boundary operator, inter- 
preted as a smooth real- valued vector field I = k{x)di, to have coefficients 

in and be such that l{x) is never tangential to dfl, i.e., (Z(t), n(x)) ^ 0 
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for every x G dO.. Then the bvp (2.1) has a finite dimensional kernel, and the 
following a priori estimate holds for the solution u G {Q.) , see [G-T], 

||^^||c'2+a(^) < ^^ll'^llco(n) \\f\\c^(Q) llp||ci+“(aO)^ 7 

if / G and g G Moreover, the problem (2.1) is solvable if finitely many 

orthogonality (complementary) conditions are satisfied by / and g. 

Suppose now that the coefficients of P and /, and the boundary dft of the 
bounded domain Q are all smooth, and assume {l{x),n{x)) ^ 0 for every 
X G dfl. Then the bvp (2.1) is of Fredholm type in the clsissical Sobolev spaces 
H^{Q) for s > 3/2, and the following a priori estimate is valid, see [El], [Tre], 

(2.2) ||M||//^(n) < C'^||u||HO(n) + ||/||if«-2(n) + ll5llf/o-3/2(9t2))i 

if / G and g G Therefore, the bvp (2.1) admits a finite dimensional 

kernel contained in C^(n), a finite dimensional cokernel contained in C®°(fl), and 
(2.1) is solvable if finitely many orthogonality conditions are satisfied by / and g. 

Remark 2.1. We would like to recall the definition of a Fredholm operator. 
Assume that Bi and B 2 are two Banach spaces and let A : > ^2 be a linear 

continuous operator. The operator A is said to be Fredholm if dim ker A < 00 and 
dim coker A < 00, where coker A = B 2 / imA. As usual, imA denotes the range 
of Bi under the mapping A. It is well known that for each Fredholm operator A 
the range imA is a closed linear subspace of ^2, and dim coker A = dim ker A*, 
where A* : is the adjoint operator of A (see [R-Sch]). According to the 

Fredholm theory, the equation y = Ax is solvable if and only if y G (ker A*)-^. In 
other words, a solution x exists if and only if y fulfills finitely many orthogonality 
conditions. By definition, the index of a Fredholm operator is given by 

ind A = dim ker A — dim coker A. 

2.1. Tangential vector fields and solvability. We will now introduce the 
classification of the vector fields I near the set of tangency to the boundary dft. 
To this end, we consider 

l{x) = r{x) T a{x)n{x) for x G dft^ 

where r{x) is a smooth real-valued vector field tangential to n{x) is the unit 
outward normal to and a{x) G C^{dQ) is a real- valued function. Having in 
mind that \l{x)\ > 0, we have, by assumption, that a{x) = 0 implies \r{x)\ > 0. 
The Shapiro-Lopatinskij condition holds in the case n > 3, if and only if, for every 
X G do., we have 0 7^ {l{x),n{x)) — a{x). 

Denote by 7p(t) the maximal integral curve of the vector field r passing 
through the point p G such that 7p(0) = p and dt^p{t) = r o ^p{t). Let 

E = {x e dQ : (l{x)^n{x)) — 0}. 

Usually, we will suppose that is a closed smooth submanifold of dQ of codimen- 
sion 1 and that 1{x)\e is transversal to E. 
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(iii) submergent v. field I 
Figure 3. Structure of the vector field I near E. 



There are three possible behaviors of the function a{x) near E: 

(i) a{x) conserves its sign on 

(ii) a{x) changes its sign through E from negative to positive in the direction 
of the vector field 1\e, 

(iii) a{x) changes its sign through E from positive to negative in the direction 
of the vector field 1\e- 

The vector field I in the case (i) is said to be of neutral type, in the case (ii) of 
emergent type, and in the case (iii) of submergent type, see Figure 3. Certainly, 
(ii) can be reformulated as: a{x) changes its sign from minus to plus in the positive 
direction on the integral curve 7 . Similarly for (iii). 

Egorov and Kondratiev assumed in [E-K] that E is a closed smooth subman- 
ifold of the boundary of codimension 1 and that l{x) is transversal to E. They 
proved that in the emergent case (ii), (2.1) becomes a Fredholm problem if an 
extra condition is prescribed: 

(2.3) u{x) = uq(x) on E. 

Under the assumptions u G s > 0, / G g G and 

uq G they proved that each solution of the bvp (2.1), (2.3), satisfies 
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the estimate 



(2.4) 






+ lkll//^+i/2(ari) + \Wo\\h^+^/‘^(e)Y 



The existence theorem is valid under finitely many orthogonality conditions im- 
posed on the triple (f,g,uo). Existence results cannot be proved in general in the 
case (iii), but the regularity still holds true. Existence results in the overdetermined 
case (iii) under additional conditions are not obtained in loc. cit. 

In the case (i) of a neutral vector field it was shown in [E-K] that the problem 
( 2 . 1 ) has finite dimensional kernel and cokernel, and an existence result was proved 
under finitely many orthogonality conditions satisfied by / and g. 

Comparing the a priori estimates (2.2) and (2.4) we see that in the case of the 
tangential oblique derivative problem, a loss of regularity 1 appears with respect 
to / and g. By means of the subelliptic theory, we will show that it is possible to 
improve the regularity that the solution u gains from / and g. 

To simplify the problem consider the bvp 



(2.5) 



Pu = 0 in Q, lu g on dCl 



in the cases (i) and (iii). We assume the coefficients and the boundary to be 
The Calderon operator from Section 1.4 enables us to reduce (2.5) to a 4^DO on 
the boundary and apply Theorem 1.8. The smooth vector field I = T{x)-\-a{x)n{x) 
is called a vector field of finite type if there exists an integer k such that 

k 

( 2 . 6 ) ^1 T^a{x)\ > 0 at each point x G dQ where a{x) = 0 . 



In other words, the function a{x) vanishes at the point x e E to order less than or 
equal to k along the integral curve 7 of the vector field r passing through x. The 
set E is not necessarily a smooth submanifold of dO.. Then, we have the a priori 
estimate 

(2.7) 

This result is optimal concerning the regularity of u. As we can see, the sharp loss of 
regularity of the solution u is equal to , where k is the maximal vanishing order 
of the function a{x) along the integral curves 7 of the vector field r. Moreover, the 
subelliptic estimate (2.7), s > |, holds only in the case of vector fields of neutral 
and submergent type. This estimate is not valid for vector fields of emergent type. 

Interesting results on the subject were proved by Winzell [W] (cf. also [Al]), 
but we will briefly discuss subelliptic estimates in Holder spaces following Guan 
[Gu]. He proved that if P is a subelliptic differential operator of order m in two 
variables, then it remains subelliptic in Holder spaces. Thus, if Pu G with 
a > 0, and u G P', then u G w. As we mentioned in Section 1, there are 
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subelliptic ^DO in Sobolev spaces that are not subelliptic in Holder classes. The 
main subelliptic Theorem 1.8 remains valid for the following classical ^DO: 

d 

L = - ha{x,Xn+\)Q in R"+\ 

OXn+l 

where Q is an elliptic ^DO of order 1 with a positive principal symbol. We will 
formulate the corresponding result only in the case (i) (i.e., when the function 
a conserves its sign), assuming that the condition (2.6) holds. Then, for each 

right-hand side / G a > 0, one can find u G such that Lu — /. 

Concerning the regularity of the solution we have that, if Lu G AJJ^^ and u G P', 

then u G . 



Remark 2.2. The assumption 



k 

E 

1=1 



5<+i 



a{x,Xn+l) 



>0 



at the points where a{x,Xn-\-i) = 0, guarantees (according to Theoreml.8) the 
subellipticity of L in Sobolev spaces with minimal loss of regularity S = -j ^ . 



Below we formulate the general result of Guan. Let I be a vector field of finite 
type A: G N, let £' be a closed smooth submanifold of 90 of codimension 1, and 
let r be transversal to E. In the case (i) of a neutral vector field /, and for a strictly 
elliptic second order homogeneous linear differential operator L with coefficients 
in C^(0), the following bvp is considered: 



n 

Lu = ^ aij{x)dfjU = f{x) in O c n > 3, 

( 2 - 8 ) 

lu = g{x) on 90; 



while in the case (ii) of an emergent vector field /, one studies the bvp 
Lu — f{x) in O, 
lu = g{x) on 90, u = 0 on E. 



(2.9) 



Theorem 2.3 ([Gu]). Suppose that / G C^(0), ^ G (7^(90) /or 9 + ^ ^ N, 
and assume that the function u G (7^(0) 0(7^ (O) satisfies the bvp (2.8) or the bvp 
(2.9). Then we claim that u G (7^(0) with 0 = min(2 + + 1^)’ 

find a constant C such that the following subelliptic estimate holds: 

(2-10) ll^llc'^(Q) < ^(ikllco(^) + WfWc^in) + WdWc^idn)^ 

Moreover, a solution of the problem (2.8) {respectively (2.9)) exists, if finitely 
many orthogonality conditions are satisfied by f and g. This solution belongs to 
the Holder class (7*^(0). 
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In [W] Winzell proved that, if u solves (2.8) with Lu G (7^(12) and lu G 
then u G (Q) fl \ for 0 < o; + < 1. Another 

interesting result is due to Alimov [Al] who studied the bvp (2.9) in the special 
case when I = f = 0^ dQ = {\x'\‘^ + \xn\^ = 1} with m > 1, n > 3, and 
E = do. n {xn = 0}. He proved that if o: > 0 and ct + ^ ^ N, then there exists 
g G (7“(517) such that u 0 (7^+^ {ft). We point out that in this case u G A^"^^ (ft) 
as it was shown by Guan [Gu]. 

All the results mentioned above are proved under very strong regularity as- 
sumptions (C^, on the coefficients and on the boundary. We now discuss 

a result on the existence of a solution of the tangential oblique derivative problem 
in the case (i) under rather weak regularity conditions imposed on the coefficients 
of the operator, on the boundary vector field /, and on the boundary dft. 

Let n be a bounded domain in ^ n > 3 with boundary dft whose regularity 
will be specified later on. W^’^(Q) denotes the Sobolev space of k times weakly 
differentiable functions such that d^u G Lp{ft) for |a| < k. As usual, 1 < p < oo. 
The corresponding norm is defined by 



( 2 . 11 ) 



lkllvi/''.!>(J2) = l|w||LP(£i) + Wu\\Lv{n) ifl<p<00, 

\oi\=^k 

l|wlk'=.~(fi) = max (m^ ess supn|5“w(a;)|). 



We will deal with dft G (7^’^, i.e., the second derivatives of the local equations 
of the boundary are Lipschitz continuous. The regularity properties of the restric- 
tion to the boundary u\dfi of an element u G W^^P{fl) can be described by means 
of the Besov spaces W^'P{dfl) with 0 < s ^ N. Let s — k-i- 6 with A: G N U {0} and 
0 < ^ < 1. Then the norm in W^^^{dft) is defined by 



(2.12) ||'i^||u/^-p(ao) 



l|i’llLp(ar!) + f 51 // ■ 

\,z7Zi.JJdn 



\d°^v{x) — d'^v{y)\'^ 



\a\=k ‘ 



\x-y\ 



n—l~\-6p 



da^da. 



More details about these spaces can be found in [Ad]. 

The main result to be used later is the following. Suppose that ft is a bounded 
domain in and dft G Then, for 1 < p < oo, the restriction map (trace) 

(2.13) p:u^v = u\sQ, p:W^’P{n) ^W^-i’P{dn), 



is well defined and surjective. 

Remark 2.4. Let dn e C°°. Then the trace p : VL''’P(fi) ^ is 

well defined for all k > -. 

p 
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Consider the oblique derivative problem in the neutral case (i): 

n 

Lu = aij{x)dfjU = f(x) in ft, 

(2.14) i.j=i 

du 

Bu ~ + cr{x)u — (f{x) on dQ. 

The following assumptions are imposed on L, and dO.: 

(2.15a) L is uniformly elliptic, i. e., one can find a constant A > 0 such that 

^ ^ ^ 

^ a.ij{x%ij < -|^|^ for every x eft, ^ 

LJ — 1 

(2.15b) CLij{x) — aji{x) for every t, and aij{x) G (7^’^(n) = 

(2.15c) If I = h{x)di, then li, a G a{x) < 0, 

O is a bounded domain with dCl G 

/(x) = r{x) — a{x)n{x) and (/(x),n(x)) < 0 for every x G dft. 

We also assume that E — {x e dO, : a(x) — 0} is nonempty. The set E is not 
required to be a submanifold of dCt. Moreover, the vector field I is tangential to 
dO, only on E, and it is oriented inwards Q on dQ \ E. 

We are looking for a solution of the bvp (2.14) belonging to the space W^’^(Q) 
for some 1 < p < oo. Therefore, the elliptic equation Lu = f is fulfilled almost 
everywhere (a.e.), and Bu = (p holds true on dLl in the trace sense. In fact, if 
u G then / G W^’^(r^) and Bu G 

Theorem 2.5 ([MaPlSo]). Suppose that the bvp (2.14) satisfies the condi- 
tions (2.15a), (2.15b), (2.15c), and the integral curves 7 of the vector field I con- 
tained in E are nonclosed and of finite length. Assume that f G W^’^(n) and 
(f G W‘^~p'^{dft) for some ^ < p < 00 . Then there exists a solution u G W^’^(fl) 
of (2.14), and there is a constant C > 0 such that 

(2-lfi) \\u\\w^,P{n) < c(^l -h ||/||velp(l?) + 

Certainly, C does not depend on the functions u, f, cp. Moreover, if p > n, then 
the solution u G is uniquely determined by f and ip. 

Remark 2.6. In the case (i) of a neutral vector field /, there is a loss of one 
unit of regularity compared with the nontangential case. In fact, as it is shown 
in [MaPlSo], the strict inequality (/(x),n(x)) < 0 on <9Q implies that for each 
/ G LP{Q), ip G W^~p'^{dLt), there exists a unique solution u G of (2.14). 

According to the Sobolev embedding theorem, the solution u of the bvp (2.14) 
belongs to the Holder class C^'^‘^~p (17) if ^ < p < n, and it belongs to C^^^~p (17) 
for p > n. Assume that is a closed smooth submanifold of dLt of codimension 




464 



PETER POPIVANOV 



1, and the vector field r(x) is transversal to E. Then the integral curves 7 of r 
certainly satisfy the requirements of Theorem 2.5. 



2.2. Modified oblique derivative problem. We will continue our short 
survey by paying special attention to the paper of Maz’ya and Paneah [Mz-Pa]. 
They described for the first time the asymptotic behavior of solutions of the tan- 
gential oblique derivative problem in a neighborhood of the submanifold ji 2 on 
which the vector field is of submergent type. They proved that for each pair (/, g) 
from a subspace of Ti(Q) x Ij2{dQ) of finite codimension AT, one can find a function 
u (with the appropriate regularity) satisfying the bvp ( 2 . 1 ) in The function 

u is unique modulo an Wdimensional space, and the restriction u\dn bas a finite 
smooth jump {u}^^ on /j .2 which is determined by / and g. This fact leads to a 
corresponding modification of (2.1). In [Mz-Pa], it was shown for the first time 
that the index of the modified oblique derivative problem is 0. Moreover, under an 
additional condition, the claissical maximum principle was proved for the modified 
problem. 

We should also mention Maljutov [Ma], who considered the modified oblique 
derivative problem and established its unique solvability by using partially prob- 
abilistic methods. The appearance of jumps and underdetermined bvp can be 
found in his paper, too. We will formulate and comment some results of Maz’ya 
and Paneah [Mz-Pa] , [Mz] , [Mz-Pal] , [Pal] , which form the basis of the very in- 
teresting monograph [Pa] . For simplicity, we will discuss the homogeneous oblique 
derivative problem, cf. (2.5). 

Let O be a bounded domain with boundary M = and assume that ft 
lies on one side of M. Consider the vector field I = r au, where u stands for the 
unit inward normal toM, i.e., i/ = — n. The vector field I may be of emergent and 
of submergent type simultaneously. The homogeneous oblique derivative problem 
in ft can be written as: 



(2.17) 



Pu = 0 in ft, — hu = g on M, 
a = r 7^ 0 on E = {x E M : a{x) = 0} 7^ 0. 



Along with the set E we introduce the open subsets C M, and the submani- 
folds /j,i ^2 of codimension 1 in M, such that: 

(1) M = M+ U M“ U /ii U /i2- 

(2) M+nM- = 0 . 

(3) dM~^ n dM = /ii U /i 2 = M 12 ? 

(4) a > 0 on M+ and a < 0 on M~ . 

(5) The vector field r is transversal to /ii U /X 2 , and it is oriented towards 
M~ on fii and towards M+ on /i 2 - 

( 6 ) The set M does not contain any semitrajectory Tp, p G M, of the vector 
field r. 

Denote by T(M) the tangent space of M, and let ~fi E C"^(/ii 2 , T(M)) be the 
vector field of unit normals to the submanifold /X 12 , oriented towards M~^. Put 
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Figure 4 

Jt- = for i = 1,2. Evidently, — {p G dM~^ n dM~ : (r, 7?)(p) < 0}. 
Geometrical illustration is given on Figure 4. The vector field I is of emergent type 
near /ii and of submergent type near /i 2 . 

Remark 2.7. Suppose that u G H^{M \ 112 ) and let u± = According 

to the Sobolev trace result ^ The jump on fi 2 of the function u 

is defined as follows: 

= U+)Im 2 - U-)U2 e 

The well known jump formula from the Schwartz distribution theory (see [Pa]) 
shows that 

du d . _ 

where the distribution = J (pdS for every cp G (7^(M), and (r, 7?2) is 

the scalar product of the vector fields r and 7 ? 2 - 

Having in mind our considerations from Section 1, we will study the following 
modified Poincare problem: 

du 

(2.18) Pu = 0 in P hu — V = g on M, u — on /ii. 

The functions g and uq are given on M and /ii, respectively, and the functions 
u and V are sought. Certainly, v is only defined on ^ 2 - Obviously, the pair {u,v) 
solves the problem 

du 

(2.19) Pu = 0 in O, —+hu = g onM \^25 u = uq on 

In other words, the solution u of the modified oblique derivative problem (2.18) 
satisfies the boundary conditions everywhere on M except, perhaps, on the sub- 
manifold /i 2 - Thus, this modification is quite reasonable as the bvp (2.17) is lo- 
cally nonsolvable in each neighborhood of an arbitrary point p G /i 2 - It is shown 
in [Mz-Pa] (see also [Pa]) that (2.18) is a Fredholm type problem with index 
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zero, and under small restrictions, this problem is uniquely solvable. It is proved, 
moreover, that if (u, v) is the solution of (2.18), then u is smooth on and the 

restriction u\m — um has a finite jump on ji 2 - Therefore, u satisfies the boundary 
condition ^ + hu— ^ = 9- According to the unicity theorem, we 

conclude that v = 7 ^ 2 ){^}/x 2 ^ other words, the right-hand side {g,uo) 

determines in a unique way the solution u in 0 \ ^2 and the jump of um on /Z 2 - 

In order to formulate other interesting results on this subject, we now introduce 
the corresponding weighted Sobolev spaces on M and fl. 

Let the symbol denote a sufficiently small neighborhood of M in fl, and 
let ~g be the vector field of geodesics normal to M, oriented towards Q on M. 
The integral curve of passing through the point p e M and contained in T 
is denoted by gp{z), \z\ < e. Let z' = (^ 2 , . . . ,Zn) be the local coordinates of p. 
To any point Q — gp{z) we associate the coordinates (z,z^). Let 9 = {rp(ti),p E 
Mi 2 , 1^1 1 < ^} C M be a neighborhood of /xi 2 - Then, 0 < s 1 implies that 9 
splits into the union of two disjoint layers 9i, ^2 formed by the shifts of /xi, /LI 2 
along the vector field r, |ti| < s. Denote by t" the local coordinates of p € pi 2 - 
Then we define in the layers ^ 1,2 the coordinates t = So we can define 

neighborhoods C D, z = 1,2, equipped with local coordinates {z,t), and such 
that M = {p E 0. : z — 0} and /ij = {p E Tq. : z = ti = 0} , see Figure 5. 

Consider now a smooth partition of unity {^j}q on M with supp 'ipj C 9j and 
'ipj = 1 near pj for j = 1,2. 

Definition 2.8. For k eNU {0}, define Hk{M,p 2 ) as the space of functions 
u E 1/2 (M) for which the norm 

k I 1 

1=0 lal:=0 j=0 



00 

is finite. We put Hoo{M,p 2 ) = f] // 2 )- The space Hk{M,pi) is defined in 

k=0 



a similar way. 



Definition 2.9. Let ^ and ^ form a smooth partition of unity on D with 
$ G C D), and ^{z,t) = 1 for 0 < 2 : < |, l^ij < f . For any m G N U {0} 
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and r G R, define the space M 2 ) as the completion of C^{ft) in the norm 

m 

fc+r H“ + ||4 -m|U+.. 

k=l 

Evidently, the elements of 1 ^ 2 ) have singularities on the submanifold M 2 , 

and ifo,r (^5 M 2 ) is the standard Sobolev space As in the previous definition, 

00 

we put Foo,r(^^,^2) = n 

m=0 

The Calderon operator (cf. Section 1) of the bvp (2.17) takes the form: 

Av — drV + aAv + hv for v G 

where Av = -^Sv\z^q, Its adjoint becomes A* = —dr + aA + h + Tq, ord To = 0. 

Theorem 2.10 ([Pa]). Let s G N U {0}. Then the following assertions hold: 

(a) The modified oblique derivative problem (2.18) has a solution (u,v) G 
-^5,i/2(^,M2)xi7^(M2) if and onlyif{g,uo) G 7fs(M, /X 2 ) x if^(jUi) satisfy 
the orthogonality conditions 

+ (wo,(t-, Ai){Wj}mi)mi =0 

for 1 < j < A' < 00 . As usual, denotes the jump of the function 

Wj G H^{M\/ai) on Hi, and the functions Wj e Hoo{M, Hi)nH^{M\Hi) 
form a basis of the solution space (kernel) of the bvp on M : 

+ (t, 7?i){w},ji ® = 0 on M, 

1 to = 0 on ^ 2 - 

(b) Let g — Uq — 0. Then (2.18) has exactly N linearly independent solutions, 
and they all belong to , 1 / 2 ( 0 , M 2 ) X H^(h2)- 

(c) Suppose that (u,v) G i(fl,M 2 ) x H^(h 2 ) a solution of (2.18) with 
right-hand side (g^Uo) G Tir(M,pi 2 ) x H'^(fjLi) and r > s. Then, the 
solution (u,v) belongs to 777 . 1 / 2 ( 0 ,^ 2 ) x H^(h 2 )‘ 

(d) Let s > 1. Then u\m € H^(M \ H 2 ) ctnd v = (r, 7^2){^}/x2 • 

Conclusion. The bvp (2.18) is a Fredholm problem with index zero. Its kernel 
and cokernel consist of C^(Ll \ H 2 ) functions, and the restriction u\m has a finite 
jump on M 2 - According to (c), we have an increase of regularity (smoothness) for 
the solution (u,v). 

Suppose now that mi 7^ ^ and H 2 7 ^ Obviously, the solution (u,v) of the 
bvp (2.18) satisfies (2.17) if u = 0. 

Theorem 2.11 ([Mz-Pa], [Pa]). Lets>l and(g,U(f) G Hs(M, H 2 ) ^ H^(/j,i). 
The bvp 

du 

(2.20) Pu = {) in Ft, — + Mu = m on M, u = uq on 
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has a solution u G if and only if the condition 

(5,Wx)M + (MO,('T>7il){Wx}Ml)Mi =0 
is satisfied for each solution G Hoo{M, jui) of the problem 



( 2 . 21 ) 



+ (r, = 0 on M, 

= X on /i 2 , 



for an arbitrary function x ^ C^{/j, 2 ). Moreover, u G for every a < 1. 

Remark 2.12. As the space of functions satisfying (2.21) is infinite dimen- 
sional, we conclude that the classical bvp ( 2 . 20 ) has a cokernel of infinite dimension 
whenever /X 2 0 . A classical solution u of the bvp (2.20) can exist if and only if 

infinitely many orthogonality conditions are imposed on g and uq. 



A similar theorem was established by Winzell [W] in Holder spaces: 

Theorem 2.13 ([W]). Given /xi / 0 and fi 2 0, consider the bvp 

du 

Pu = 0 infl, c{x)<0, ~ 9 onM\p 2 , u = uq on pi. 

Then, for arbitrary functions g G C^"'”“(M) and uq G 0 < a < 1, the 

above problem has a unique solution u G \ P 2 ) H 

In the previous considerations concerning the bvp (2.17) it was assumed that 
the vector field r was transversal to the manifolds p\ and p 2 that separate M“*" 
from M~ . In this way, the set pi on which (2.17) is underdetermined, and the set 
P 2 on which (2.17) is over deter mined, are far from each other. As far as we know, 
the paper of Maz’ya [Mz] is the only one where the above mentioned restriction 
is overcame. It is worth mentioning that in [Mz] the vector field I is allowed to 
be tangential to a series of submanifolds contained in M, and moreover, I could 
be simultaneously of both emergent and submergent types along one of these 
submanifolds. 

As before, let 0 be a smooth bounded domain in n > 3, M = d9l, and let 
M = Mo D Ml D ... D Mfc, M/c 7 ^ 0 , be a series of compact submanifolds 
without boundary. The vector field I is tangential to each submanifold Mj only 
at the points of Mj+i, and I is not tangential to M^. The assumption that M~^ 
and M~ are nonempty, implies that 0 ^ p\{J p 2 0 Mi \ M 2 - The vector field 
r fulfills condition (5) formulated after (2.17). Consider now the problem (2.19) 
with uo = 0. In [Mz] the author defines a weak solution of the bvp (2.19) such 
that € i7^/^(M) and p ~^ u\m ^ L\oc(M\p 2 )^ where p{x) = dist(x, /ii). 

Theorem 2.14 ([Mz]). Suppose that P{1) 0. Then, for every function 

g G LS{M) there exists a unique weak solution of (2.19). 



The previous result can be illustrated by the following example: 
ft = {x ^ 'MP : Xn > 0}, n > 3, M = {x ^ : Xn = 0}, 

I = diP Xid2 + . . . + Xn-ldn- 
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In this situation, 

G : Xn == 0, ^ o|, 

Mj = {a: G = Xn-i = ... = Xn-j-i =0} for j = 0, . . . , n — 2, 

Ml, 2 = |x G R’^ : = Xn-l = 0, Xn~2 ^ o|. 

3. Open problems 

We are going to formulate two open problems concerning the tangential oblique 
derivative problem. From our point of view, they are interesting problems as they 
have applications in the theory of probability and in the theory of Brownian mo- 
tion. On the other hand, their possible solvability will be a contribution to the 
theory of degenerate boundary value problems for (non) linear second order ellip- 
tic operators in Holder spaces. 

Problem 1. 

(i) Consider a classical first order ^DO P{x, D) with the principal symbol 

= ^ 1 — where a (x,^') and h{x,(J) are real- valued 
functions, not identically 0. Assume that P(x, D) is a subelliptic operator 
in the scale of Sobolev spaces . Under which conditions is P{x,D) a 
subelliptic operator in the Holder classes A^, s > 0, with the same loss 
of regularity as in P®? 

(ii) After solving (i) try to develop in the Holder classes A^, C^’“, 0 < a < 1, 
the theory of the following bvp: 

{ Lu — F in ft C R’^, n > 3, 

\^ + i<^ + ib)t\M=9 onM = dn. 

As usual, n is a bounded domain with smooth boundary M, n is 
the unit outward normal to M, L is a second order elliptic operator, 
and a,b ^ C^{M) are real- valued functions. Moreover, we assume that 
= 0 and a\(^M\E) ^ 0? where P C M is a smooth submanifold of M of 
codimension one. The smooth nondegenerate vector field r is tangential 
to M and transversal to E. 



Remark 3.1. At the end of of Section 1 we showed an example of a ^DO 
which is subelliptic in Sobolev spaces but is not subelliptic in Holder spaces. 



Problem 2. Let ft he Si bounded domain in n > 3, M = dft e C^. 
Consider the bvp 



\ F{x^u, Du, D‘^u) = 0 in fl, 

1 Sr X e M, 

in the cases of a neutral or emergent real smooth vector field I ^ C^,b ^ C^. When 
I is of emergent type, the bvp (3.1) is studied with the extra condition = uq, 
imposed on the set of tangency E. 
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Denote by S'^ the space of all n x n symmetric matrices. Then the real-valued 
function F G x M x x 5^) defines an elliptic PDE and satisfies the 

convexity property: 

A|^l^ < < A|^|2 for every i € K”, 

i,j = l 

where A and A are some positive constants. Moreover, 

2 

E dr dr C e IR" > Co = const > 0. 

ij = l 

(i) Find sufficient conditions for the existence and uniqueness of a classical 
solution u e C^(Q) fl C^{ft) of the bvp (3.1); with the extra condition 

= '^^0 if ^ is of emergent type. 

(ii) Suppose that F G 0 < o; < 1, and l,b,g,uo G Can we claim 

that u G 

Remark 3.2. The case of a semilinear PDE was investigated in details in 
[P-Pl]. Under several restrictions, a unique viscosity solution of the bvp (3.1) is 
constructed in [P-K]. 
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A note on boundary value problems on manifolds 
with cylindrical ends 

Marius Mitrea and Victor Nistor 



Abstract. We present an extension of the method of layer potentials to man- 
ifolds with boundary and cylindrical ends. To obtain this extension along the 
claissical lines, we have to deal with several technical difficulties due to the 
non-compactness of the boundary, which prevents us from using the standard 
characterization of Fredholm and compact (pseudo-) differential operators be- 
tween Sobolev spaces on compact manifolds. 

As an application, we obtain a solution of the non- homogeneous Dirich- 
let problem in this setting. We also prove the existence of the Dirichlet-to- 
Neumann map in the class of pseudodifferential operators which are “almost 
translation invariant at infinity.” 



Introduction 

Starting with the pioneering work of Hodge, de Rham, Kodaira, Spencer, Duff, 
Kohn, among others (cf. the discussion in the introduction of [18]), the method 
of layer potentials has been widely used to solve boundary value problems on 
compact manifolds with smooth boundary. See, for instance, [4, 6, 7], or [8], and 
the references cited therein. More recently, the method of layer potentials has also 
lead to a solution of the Dirichlet problem for the Laplace operator on compact 
manifolds with Lipschitz boundaries in [16]. 

In view of several possible applications, we would like to extend the method of 
layer potentials to various classes of non- compact manifolds. There are, however, 
several technical problems that we need to overcome first for such an extension 
to be possible - at least along the classical lines. The main contribution of this 
paper is to explain how these difficulties are dealt with in the particular case of 
manifolds with cylindrical ends, when a number of required results from analysis 
take a simpler form. We hope that the approach that we outline in this note will 
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be a paradigm for dealing with some of the issues that arise in the study of elliptic 
boundary value problems on more general non-compact manifolds with the method 
of layer potentials. 

In fact, let us make it clear now, that, with some additional work, it is also pos- 
sible to obtain parts of some our results using the classical, ground-breaking paper 
of Kondratiev [3, 9, 12, 19]. Kondratiev deals typically with general boundary 
value problems and establishes their Fredholm character (or “normal solvability”) 
and asymptotic expansion of the solutions. His methods are elementary, using the 
gluing of model operators. Our method, although more complicated and less ele- 
mentary, has the advantages that it provides an explicit formula for the solutions 
of our elliptic boundary value problems, it describes explicitly the Sobolev spaces 
that arise on the boundary, and, most importantly, it characterizes the Dirichlet- 
to-Neumann map. This is important in computational mathematics as well as in 
some emerging applications of boundary value problems on non-compact manifolds 
to spectral theory and index theory. 

In order to explain some of the technical difficulties encountered in this set- 
ting, we need some notation. Let AT be a non-compact Riemannian manifold with 
boundary dN and An = d*d be the Laplace operator on scalar functions. A first 
set of problems consists of defining an elementary solution £'(•,•) for Aat on A 
and proving that the associated single and double layer potential integrals con- 
verge -issues well-understood when N is compact. A second set of problems has 
to do with the existence of the non-tangential limits of the aforementioned layer 
potential integral operators. Finally, even if the non-tangential limits exist and are 
given by pseudodifferential operators on dN, these pseudodifferential operators 
will not be properly supported in general. Moreover, since dN is non-compact, the 
standard results on the boundedness and compactness of order zero (respectively, 
negative order) pseudodifferential operators do not (directly) apply. 

To overcome the above technical problems, it is natural to make certain addi- 
tional assumptions on the non-compact manifolds N and dN. Thus, in this paper, 
we have restricted ourselves to the class of manifolds with boundary and cylindrical 
ends. This is arguably the easiest to understand class of non-compact manifolds. 

Let A be a manifold with boundary and cylindrical ends. Such manifolds have 
a product structure at infinity in a strong sense (that is, including also the metric, 
see Definition 5.1). To study boundary value problems on N, it is necessary to 
consider also manifolds with cylindrical ends without boundary. Thus, let in what 
follows M denote a manifold with cylindrical ends. Typically, M will be either dN 
or a manifold of the same dimension as N containing A" as a subdomain. 

It is convenient to deal with layer potentials using pseudodifferential operators. 
We shall consider on M two classes of pseudodifferential operators: ^[JJ^(M) and 
^^(M), whose distribution kernels form a class large enough to contain those 
appearing in the boundary layer integrals considered in this paper. These classes 
are very closely related to the so called 5-calculus [13, 14], but different. 

The first class of operators is the class of order m, classical pseudodifferential 
operators that are “translation invariant in a neighborhood of infinity” (Definition 
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1.1). The space consists of the closure of with respect to a 

suitable family of semi-norms (see Equations (1.5) and (2.1)). Then we let 

(0.1) := (M) + 

An operator P G ^^(M) is called almost translation invariant in a neighborhood 
of infinity. 

The reason for introducing this class of operators is that G ^~j^(M) 
for any elliptic operator T G ^^(M) provided that m > 0 and T is invertible 
on L‘^{M). (Anticipating, this means that the algebras ^^(M) are spectrally in- 
variant, Definition 2.3, a property not enjoyed by the 6-calculus, but enjoyed by 
Melrose’s c-calculus, [10]). This allows us to define our integral kernels - and, 
implicitly, also the boundary layer integrals - much as in [ 16 ], namely as follows. 
First, we embed our manifold with boundary and cylindrical ends N into a man- 
ifold with cylindrical ends M (and without boundary). We then prove that for 
suitable V > 0, V ^ 0, the operator Am + is invertible by checking that it is 
Fredholm of index zero and injective. 

Let Sqn ffie conditional measure on dN (defined using the Riemannian met- 
ric) . If / G {dN ) , then integration on ON against / defines a distribution f 

by the relation {f <S)SdN,^) = where cp is an arbitrary test function on N. 

The single layer potential integral is defined then as 

(0.2) Sif) = {AM + V)-\f®69N). 

We shall fix in what follows a vector field djy on M whose restriction to dN is 
the unit outer normal to dN. If / G Lfi‘{dN)^ then we obtain similarly a distribution 
/ by the relation (/ ® 6qj^,(p) = fdjycp. Then the double layer potential 

integral is defined as 

(0.3) V{f) = {AM + Vr\f®S'9^). 

Since we are dealing with non-compact manifolds (M and dN), the above integrals 
are defined by relying on mapping properties of the operators in ^^(M). 

Next, we show that we can make sense of the restriction to dN of the kernel 
E of (Am + V)~^, thus obtaining S := [{Am PV)~^]dN ^ "^~^^{dN). We can then 
relate the non-tangential limits of the single and double layer potentials of some 
function / using the operator S. 

Similarly, let A" := [(Am P V)~^d*]oN^ by restricting the kernel of (Am + 
V)~^d* to dN. Let f± be the non-tangential pointwise limits of some function / 
defined on M \ dN, provided that they exist. 

Some of the properties of the single and double layer potentials alluded to 
above are summarized in the following theorem. 

Theorem 0.1. Given f G L‘^{dN), we have 

(0.4) 5(/)±=5/, d.S{f)± = {±y + K*)f, P(/)±= (t|/ + /^)/, 

where K* is the adjoint of K. 
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These theorems are proved by reduction to the compact case [16]. As in the 
classical case of a compact manifold with smooth boundary, we obtain the following 
result. 

Theorem 0.2. Let N be a manifold with boundary and cylindrical ends. Then 
W{N) 3u^ (AwM,Mlaw) e W~^{N) © 
is a continuous bijection, for any s > 1/2. 

The above theorem for s integer (without an explicit description of the Sobolev 
spaces on the boundary) can also be obtained from results of Kondratiev [9, 12, 
19] in the closely related setting of manifolds with conical points and of totally 
characteristic operators on manifolds with boundary. See [3] for a sketch of a 
derivation of our theorem using Kondratiev’s results. 

In [ 22 ] , Schrohe and Schulze have generalized the Boutet de Monvel calculus to 
manifolds with boundary and cylindrical ends. Their results are very general and 
can probably also be used to prove our Theorem 0.2 above. Our proof, however, is 
shorter, and also leads to a characterization of the Dirichlet-to-Neumann boundary 
map, Theorem 5.7. It is worth pointing out that our methods can also handle 
non-smooth structures (cf. §4) and seem amenable to other beisic problems of 
mathematical physics in non-compact manifolds (such as Maxwell’s equations in 
infinite cylinders). We hope to return to these issues at a later time. 

The reader is referred to [21, 24], or [25] for definitions and background ma- 
terial on pseudodifferential operators. Note that in our paper we work exclusively 
with manifolds of bounded geometry. 

Let us mention here that the proofs of some results are only sketched and some 
standard proofs are omitted altogether. Moreover, for clarity, we concentrate in 
this note on the Laplace operator, which is anyway one of the most important cases 
of the general theory. Full details of the proofs, as well as some generalizations will 
appear elsewhere. 

Acknowledgment. The authors are grateful to B. Ammann, T. Chris- 
tiansen, J. Gil, R. Lauter, G. Mendoza, B. Monthubert, and the referee for useful 
discussions. 



1. Operators on manifolds with cylindrical ends 

We begin by introducing the class of manifolds with cylindrical ends (without 
boundary) and by reviewing some of the results on the analysis on these manifolds 
that are needed in this paper. 

1.1. Manifolds with cylindrical ends and the Laplace operator. Let 

Ml be a compact manifold with boundary dMi ^ 0. We assume that a metric 
g is given on Mi and that gi is a product metric in a tubular neighborhood 
V = dMi X [0, 1) of the boundary, namely 

(1.1) 9i=9d + {dxf, 
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where x G [0, 1) is the second coordinate in dMi x [0, 1) and qq is a metric on 
dMi. Let 

(1.2) M := Ml U {dMi x (-oo,0]), dMi = dMi x {0}, 

be the union of Mi and dM\ x (— oo,0] along their boundaries. The above decom- 
position will be called a standard decomposition of M. The resulting manifold M 
is called a manifold with cylindrical ends. Note that a manifold with cylindrical 
ends is a complete, non-compact, Riemannian manifold without boundary. 

Let M = Ml U (^Mi x (— cxd, 0]) be a manifold with cylindrical ends. Let g 
be the metric on M and assume, as above, that g = qq (dx)‘^ on the cylindrical 
end dMi x (— oo, 0], where x G (— oo, 0] and go is a metric on the boundary of Mi. 
Let Am = d*d he the (scalar) Laplace operator on M, and Aqmi be the Laplace 
operator on 5Mi, defined using the metric gg. Then 

(1-3) Am = + AaMi 

on the cylindrical end dMi x (— oo,0]. 

1.2. Operators that are translation invariant in a neighborhood of 
infinity. Let M = Mi U {dMi x (— oo,0]) be a manifold with cylindrical ends, as 
above, and let, for any s > 0, 

(1.4) : dMi X (—00,0] — ^ dMi x (— oo, — s] 

be the isometry given by translation with — s in the x-direction. If s < 0, then (fs 
is defined as the inverse of (^_ 5 . We shall write (j)s instead of for the induced 
action on functions: </> 5 (/)(a:) = f{4>s{x)), in order to keep the notation simple. The 
special form of the operator Am obtained at the end of the previous subsection 
suggests the following definition. 

Definition 1.1. A continuous linear map P : C^{M) C^[M) will be called 

translation invariant in a neighborhood of infinity if its Schwartz kernel has support 
in 

Vi ■■= {{x,y) € M^; dist(x, 2 /) < e}, 

for some 6 > 0, and there exists R > 0 such that PSsif) — SsPif), for any 
/ G C^{dMi X (- 00 , -R)) and any s > 0. 

We shall denote by ^[^^(M) the space of order m, classical pseudodifferential 
operators on M that are translation invariant in a neighborhood of infinity. 

Let V{T) denote the domain of a possibly unbounded operator T. Recall that 
an unbounded operator T : V{T) X defined on a subset of a Banach space 
Y and with values in another Banach space X is Fredholm if T is Fredholm as 
a bounded operator V{T) X, where V{T) is endowed with the graph norm. 
Equivalently, T is Fredholm if it is closed and has finite dimensional kernel and 
cokernel. Also, T is called invertible if T is invertible as an operator V{T) X. 
For all differential operators considered below, we shall consider the minimal closed 
extension, that is, the closure of the operators with domain compactly supported 
smooth functions. 
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For each s G M, we shall denote by H^{M) the domain of regarded 

as an unbounded operator on i.e., 

( 1 . 5 ) H^{M) + 

We endow H^{M) with the norm 

Nu = ii(7+AMr/ML^ 

(Below, we shall occasionally write || • || instead of || • Hl^-) Note that / + Am > Y 
so that \\u\\s > ||i^|| for s > 0. 

As usual, we shall denote by the dual of if^(M), via a duality pairing 

that extends the pairing between functions and distributions. We thus identify 
with a space of distributions on M. 

Let (Ts(P) G (T* M) / (T* M) be the principal symbol of an operator 
P ^ ^fnv(M)- See [21, 24], or [25]. 

Lemma 1 . 2 . Let M be a manifold with cylindrical ends. 

(i) C principal symbol 

<7,: ^ S^{T*M)IS^-\T*M) 

induces, for any s G M, an isomorphism onto the subspace of symbols 
that are translation invariant in a neighborhood of infinity. 

(ii) P G extends to a continuous operator P: (M) 

if s, s' G M. 

Let us now recall a classical and well-known construction. We shall use Mel- 
rose’s terminology. Any operator P : CY^{M) C^{M) that is translation invari- 
ant in a neighborhood of infinity will be properly supported (that is, P{CY^{M)) C 
C^(M)) and gives rise to a pseudodifferential operator P: CY^{dMi x M) ^ 
C^\dMi X R) by the formula 

(1-6) P(/)-0_,P0,(/), 

where is the translation by s on the cylinder dM\ x R and s is arbitrary, but 
large enough so that 

supp{P(t>sif)) , supp(</>5(/)) C dMi X (-00,0) C M. 

Definition 1 . 3 . The operator P will be called the indicial operator associated 
with P. The resulting map 

4>: 3 P^ Pe X R) 

will be called the indicial morphism. 

Let us notice now that dMi x M is also a manifold with cylindrical ends. The 
partially defined action of R on the ends of M extends to a global action of R on 
dMi X R. We shall denote by x R)^ the operators in x R) 

that are translation invariant with respect to the natural action of R on dMi x R. 
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Let T G X and 77 be a smooth function on E x dM\ with support in 

(- 00 ,- 1 ) X equal to 1 in a neighborhood of infinity. Then 

(1.7) So{T):=r]Trj 
defines an operator in ^^^(M). 

Lemma 1.4. Let sq be as in Eq. (1.7). Then ^{sq{T)) — T for all T G 
X E)^. In particular, the range of the indicial morphism ^ of Defi- 
nition 1.3 IS X E)^. 

In order to deal with operators acting on weighted Sobolev spaces, we shall 
need the following lemma. (See also [13].) We shall denote by [a, 6 ] := ab — ba the 
commutator of two linear maps. 

Lemma 1.5. Let P, Pi G ^^^(M) be arbitrary and p: M [1, 00 ) be a smooth 
function such that p{y, x) = x on a neighborhood of infinity in dM\ x (— 00 , Oj. Then 

(i) Q^PPi, ifQ^PPi. 

(ii) ad,(P) [p, P] = pP - Pp G ^^.(M). 

Proof. The relation (i) follows by chasing definitions. To prove (ii), we can 
assume that M = X x E. Let (^ 5 , s G E, be translation by s along E. We can 
assume that P is translation invariant, in the sense that (!)s{P) = P, for any s > 0. 
Then 

(1.8) = [M^),<l>s]{P)\ = [x + s,P\ = [x,P]. 

Thus [x, P] is also E-invariant. 

In general, p = x in a neighborhood of the infinity, so the result follows. □ 

We shall need on several occasions a function p as in the above lemma, so we 
fix one throughout the paper. 

The properties of the indicial operators P are conveniently studied in terms of 
“indicial families.” Indeed, by considering the Fourier transform in the E-variable, 
we obtain by Plancherel’s theorem an isometric bijection (that is, a unitary oper- 
ator) 



(1.9) P-. L\dMi X R) ^ l2(9Mi X R), P{f){y,T) [ e-^^^f{y,t)dt. 

V^TT Jm 

Hereafter, i The indicial family P{r) is then defined by 

(1-10) P(r)[P(/)(.,r)]:=P(P/)(.,r). 

2. A spectrally invariant algebra 

A serious drawback of the algebra ^^^(M) is that it is not “spectrally in- 
variant,” in the sense that the inverse of an elliptic operator P G 4^^.^(M) that 
is invertible on is not necessarily in this algebra (Definition 2.3 below). In this 
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section we slightly enlarge the algebra so that it becomes spectrally in- 

variant. This will lead us to an algebra of operators that are “almost translation 
invariant in a neighborhood of infinity.” 

2.1. Operators that are almost translation invariant in a neighbor- 
hood of infinity. We begin by introducing another algebra of pseudodifferential 
operators that will be very useful later on. Let p be a smooth function as in 
Lemma 1.5. Recall that adp(T) := [p, T]. Assume T: C^{M) C^{M) to be a 

linear map with the property that 

ad^(T) := [p,[p,...,[p,T]...]] 

extends to a continuous map ad^(T) : for any m € Z+. Let 

||T||fc,m denote the norm of the resulting operator ad^(T). Recall the section sq 
defined in Eq. (1.7). 

We define to be the closure of with respect to the countable 

family of semi-norms 

(2.1) T^||T||fc,„, and T ^ ||p'(T - so($(T)))p'||o,„^. 

where /c,m, ^ G Z+. Then is a Frechet algebra (that is, a Frechet space 

endowed with an algebra structure such that the multiplication is continuous). 
Finally, we define 

(2.2) ^-(M) -f- (M) + 

An element P G ^^(M) will be called almost translation invariant in a neighbor- 
hood of infinity. 

It is interesting to observe now that we can introduce dependence on p at 
infinity (thus obtaining variants of Melrose’s 6-calculus, see [ 13 ] and [ 10 ]). This is 
done by noticing that for any P G ^[[[^(M) and any G N there exists a bounded 
operator where 2k < N — m, such that 

p-appa _ (Aad^^(P) = P^/^RnP^'^. 

i=o 

(Above, (p := a(a — 1) . . . {a-j-\-l)/j\ stand for the usual “binomial” coefficients.) 
In view of further applications, we also introduce the weighted Sobolev space 
which is the space of distributions of the form with u G 
We endow p^H^{M) with the norm 

ll/IU,a := ||p-“/IU. 

We have then the following classical results about almost translation invari- 
ant pseudodifferential operators on the manifold with cylindrical ends M, see [ 14 ] 
for a proof in the spirit of our paper, or [ 9 , 10 , 11 , 15 , 20 , 22 , 23 ]. These re- 
sults generalize the corresponding even more classical results on pseudodifferential 
operators on compact manifolds. 
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Theorem 2.1. Let M he a manifold with cylindrical ends and P G ^^(M). 
Also, let p > 0, p{y,x) = x on a neighborhood of infinity in dM\ x (— oo,0]. Let 
s, a G E he arbitrary, but fixed. Then: 

(i) P extends to a continuous operator P : p^H^~^{M). 

(ii) P : p^P[^{M) is compact for any a' < a and m! > m. 

(iii) P: p^H^{M) p^H^~^{M) is compact 4=^ <J^(P) = 0 and P = 0. 

(iv) P: p^H^{M) p^H^~^{M) is Fredholm cfm{P) is invertible and 

the operator P: H^{dMi x M) x M) is an isomorphism. 

Proof. This theorem follows for example from the results in [13], or the older 
preprint [14]. □ 

As a consequence of the mapping properties and closeness under composition 
of the algebra we obtain the following result. 

Corollary 2.2. Let P g m > 0, be elliptic. If P is symmetric on 

C^{M), then it is essentially self-adjoint. 

Proof. It is enough to prove that the range of P ± is dense. We deal only 
with Ppil, because the other case is completely similar. Denote the inner product 
on L‘^{M) by ( • , * ). Assume the range of P -h z7 is not dense, then there exists 
rj G L‘^{M) such that 

((P + Z/K,7y)=0 

for all ^ G C^{M). Then (P — il)r] = 0 in the sense of distributions. Select 
Q G such that Q{P - il) ^ I - R, where R G Then p = Rrj. 

Choose rjn ^ ^ in L‘^{M). By the definition of 4^“-^(M), we can 

find operators Rn G such that 

(2.3) \\R - RnlWm' := Il(/ + Ar'/\R - R„){I + A)”*'/2|| ^ 0, 

for m' > m. Then := RnPn Rp — in L‘^{M) as well, and ^ C^{M). 
Moreover, 

(2.4) (P - tl)^n = (P - tI)RnVn ^ (P ~ iI)Rt] - (P ~ il)r] = 0, 

because the operators {P—iI)Rn are bounded and converge in norm to {P~iI)R G 
Let P be the closure of P: C^{M) — > L‘^(M). We have thus proved that 
77 is in the domain of P, which is a contradiction, since it is well known that P — il 
is injective. □ 

To formulate the following results, it is convenient to use the class of “spec- 
trally invariant” algebras. 

Definition 2.3. Let A be an algebra of bounded operators on some Hilbert 
space TL. We say that A is spectrally invariant if, and only if, (7 + T)“^ G 7 + A, 
for any T e A such that 7 + T is invertible as an operator on H. 

The following theorem is the main result of this section. It states that 
is spectrally invariant in a certain sense. 
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Theorem 2.4. Let T G m >{), he such that T is invertible as a 

{possibly unbounded) operator on L^(M). // m > 0^ we assume also that T is 
elliptic. Then T~^ e 

2.2. The “A + V trick”. Recall that an operator L, mapping into 
distributions, is said to have the unique continuation property if ix = 0, whenever 
Lu = 0 and u vanishes on some open subset. 

Proposition 2.5. Let L g ^^(M) be non-negative {that is, L > 0) and 
satisfy the unique continuation property. Also, let V G C°^{M) H {that is, 

V is translation invariant in a neighborhood of infinity), P > 0, such that V is 
strictly positive on some open subset of M. Assume L -{-V: H^{M) LF‘{M) is 
Fredholm. Then L FV is in fact invertible. 

Proof. The assumptions L > 0 and V >0 imply L-\-V > 0, as well. Assume 
by contradiction that L V: H'^{M) LA{M) is Fredholm but not invertible. 
This shows that 0 must be an eigenvalue of L -\-V . A simple calculation with 
inner products, using also the unique continuation property, shows that this is not 
possible. □ 

Example 2.6. If T g has the unique continuation property then 

L := T*T satisfies the hypotheses of the above proposition (with m = 2k). In 
particular, this is the case for Am = d]^dM, since the kernel of dM consists of 
only locally constant functions. 

The following theorem is crucial for our approach to extending the method of 
layer potentials to manifolds with cylindrical ends. 

Theorem 2.7. Let M he a manifold with cylindrical ends and V > 0 be a 
smooth function on M that is translation invariant in a neighborhood of infinity 
and does not vanish at infinity. Denote by Am the Laplace operator on M. Then 
Am + V is invertible as an unbounded operator on LA{M) and {Am + G 

Proof. For starters. Am is non- negative (Am > 0) and has the unique 
continuation property (cf. the previous example). Since the potential V is non- 
negative, as well as strictly positive on some non-empty open set, our result will 
follow from Proposition 2.5 as soon as we show that Am + V : H‘^{M) — ^ LA{M) 
is Fredholm. 

Since Am is elliptic, P Am + V : H‘^{M) LA{M) will be Fredholm if, 
and only if, P is invertible. In turn, to show that P is invertible it suffices to prove 
the norm of the inverse of P{t): H‘^{dMi) L?{dMi) is bounded uniformly in 
r G M. 

More specifically, let Voo G C^{dM\) be the limit at infinity of the function 
V. (This limit exists because we assumed V to be translation invariant in a neigh- 
borhood of infinity.) Denote A = A^Mu to simplify notation in what follows. By 
definition, we have P{r) = A + -h 14© • Since I4o + > 0 and does not vanish 
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identically for any r G M, by assumption, we obtain as in [16] that P{r) is indeed 
invertible for any r G M. A standard calculation also shows that the norm of the 
inverse is uniformly bounded. 

This can be seen for example as follows. Assume that P is elliptic of order 
m. Then there exists J? > 0 such that P{r) is invertible as a map H'^{dMi) 

for any |r| > R. Moreover, P(r)~^ depends continuously on r on its 
domain of definition. See [21], especially Theorem 9.2, for details. □ 

3. Boundary layer potential integrals 

We want to extend the method of boundary layer potential to manifolds with 
cylindrical ends. We begin by introducing the class of manifolds with boundary 
that we plan to study in this paper. 

3.1. Submanifolds with cylindrical ends. Let iV C M be a submanifold 
with boundary of a manifold with cylindrical ends. We want to generalize the 
method of layer potentials to this non-compact case. We notice that N plays a 
role in the method of boundary layer potentials mostly through its boundary dN. 
Because of this, we shall formulate some of our results in the slightly more general 
setting when dN is replaced by a suitable submanifold of codimension one. This 
slightly more general setting actually allows for simpler proofs. 

Definition 3.1. Let M = MiU{dMi x (-cxd, 0]) be a manifold with cylindrical 
ends. A submanifold with cylindrical ends of M is a submanifold Z C. M such that 

Zn(dMi X (-00,0]) = Z' X (-00,0], 
for some submanifold Z' C dMi. We shall write then Z ~ Z' x (— oo,0]. 

We shall fix Z, Z' as above in what follows. Our main interest is of course 
when Z = dN, but for certain reasonings, it is useful to allow this slightly greater 
level of generality. 

Let us recall from [25, vol. II, Proposition 2.8], that a distribution L on xR’^ 
is the kernel of a classical pseudodifferential operator of order — j, j = 1,2 ,..., if, 
and only if, 

oo 

(3.1) L r^'^{qi{x,z) +pi{x,z)ln\z\) 

1=0 

where qi are smooth functions of x with values distributions in z that are homoge- 
neous of degree j+l—n and smooth for 2; 7^ 0, and pi are polynomials homogeneous 
of degree j + / — n. (The sign in Eq. (3.1) above means that the difference 
L — + Pi(^5 kl) is as smooth as we want if N is chosen large 

enough.) 

It is not difficult to check that the converse holds true also for j — 0 under 
some additional conditions, for example when po = 0 and qo{x, z) is odd in z and 
the associated distribution is defined by a principal value integral. Below, we shall 
identify M with the diagonal of M x M. 
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Theorem 3.2. Let M be a manifold with cylindrical ends and let Z C M be 
a codimension one submanifold with cylindrical ends, as in Definition 3.1. If P ^ 
m < —1, is given by the kernel K G \ M), then the restriction 

of K to Z‘^ \ Z extends uniquely to the kernel of an operator Pz G 
The same result holds true with ^^(M) and replacing and 

Moreover, if a m{P) is odd, then we can also allow m = —1, provided that we 
define Pz by using a principal value integral. 

Proof. Let P g Then K is supported in a set of the form 

Ve := {(x,y) e M^, dist(a;,?/) < ej, 

by Definition 1.1. Clearly the restriction of K to Z^ \ Z will be supported in 
Ve n Z^. Moreover, by using the expansion recalled above, Eq. (3.1), we see that 
K\zxz is the kernel of a unique pseudodifferential operator on Z of order < m + 1. 
The translation invariance of this operator follows from the definition. 

To prove the same result for operators that are almost translation invariant in 
a neighborhood of infinity, it is enough to do this for order — oc operators. Because 
the proof is local in a neighborhood of Z, we can assume that M — Z x in 
which case 

(3.2) □ 



We need now to investigate the relation between restriction to the submanifold 
Z of codimension one in M and indicial operators. 

Proposition 3.3. Let Z c M be as in Definition 3.1, with Z of codimension 
one, Z ^ Z' X (— oo,0] in a neighborhood of infinity. Let P G m < — 1. 

Then Pz'xR = Pz and [P(r)]z' = Pz{r). 

3.2. Boundary layer potential integrals. We now proceed to define the 
boundary layer potential integrals. Let M be a manifold with cylindrical ends and 
Z C M be a submanifold with cylindrical ends of codimension one. (Later on we 
shall restrict ourselves to the case when Z = dN , where AT C M is a submanifold 
with boundary and cylindrical ends. For now though, it is more convenient to 
consider this more general case.) 

Let 8z be the surface measure on Z, regarded as a distribution on M. If 
/ G LP‘{Z), then f ^ Sz ^ a > 1/2. Similarly, if 6'^ is the normal 

derivative of Sz, then f ^ S'^ e a > 1/2. 

Definition 3.4. Fix a smooth function V >0,V e V not identical 

equal to 0, but vanishing on a neighborhood of Z. Let / G LF‘{Z) and a > 1/2. 
The single layer potential integral associated to Z C M and Am + P is defined as 

5(/) := {AM + V)-\f®Sz) € 
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and the double layer potential integral associated to Z c M and V is defined as 
nf) ■= (Am + V)~\f <g S'z) e 

Assume that the normal bundle of Z in M is oriented (so there will be a 
positive side and negative side of Z in M). As in [ 16 ] we shall denote by f± the 
non- tangential limits of some function defined on M \ Z, when we approach Z 
from the positive side (-h), respectively from the negative side (— ), provided, of 
course, that these limits exist pointwise almost everywhere. (It is here where we 
need the normal bundle to Z to be oriented.) 

We now begin to follow the strategy of [ 16 ]. Let 

(3.3) S:=[{AM + Vr^ze^:^(Z). 

We shall fix in what follows a vector field di, on M that is normal to Z at every 
point of Z. The principal symbol of the order —1 operator (A -h V)~^d^ is odd, so 
we can also define 

(3.4) K := [(Am + Vy^dtU G (Z). 

Proposition 3.5. With the above notation, the operator S of Eq. (3.3) is 
elliptic. Moreover, the zero principal symbol of K vanishes, cto{K) = 0, and hence 
actually K G ^~j^(Z). 

Proof. First, the fact that S is elliptic follows from a symbol calculation 
(which is local in nature) analogous to [18, (3.42), p. 33]. In fact, similar consid- 
erations show that (Tq{K) == 0 so, in fact, K e ^“^^(Z). See also the discussion in 
[ 25 , vol. II, Proposition 11.2, p. 36]. □ 

Theorem 3.6. Let Z C M be a codimension one submanifold with cylindrical 
ends. Assume the normal bundle to Z is oriented. Given f € L‘^{Z), we have 

5 (/)+= 5 (/)_= 5 / 

as pointwise a.e. limits. Also, using the notation of Eq. (3.4) above, we have 

d.S{f)i=(±\l + K*)f, 
where K* is the adjoint of K. 

Proof. Let us write T := (Am A- V)~^ = P -h R, where P G (so it 

is translation invariant in a neighborhood of infinity) and R G 4^“j°°(M). The first 
statement of the proposition, namely 

[T{f^Sz)]±=Tzf 

is clearly linear in T G ^^(M), m < — 1. It is enough then to prove it for P and 
R separately. 

For T = (A + F)“^ replaced by P, this is a local statement, which then follows 
from [ 16 , Proposition 3.8]. For T replaced by R, the proof is local in a tubular 
neighborhood of Z, so we can assume that M = Z x S^. Then the result follows 
again from Eq. (3.2). □ 
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The following theorem is proved in a completely similar way, following the 
results of [16, Proposition 3.8]. 

Theorem 3.7. Let Z be a codimension one submanifold with cylindrical ends 
of M with oriented normal bundle. Given f G LZ{Z), we have 

V{f)±=[^I + K)f 



as pointwise a.e. limits. 

For further reference, let us discuss now the “trace theorem” for codimension 
one submanifolds in our setting. See [2] for more details and results of this kind 
for manifolds with a Lie structure at infinity [1]. 

Proposition 3.8. Let Z C M be a submanifolds with cylindrical ends of the 
manifold with cylindrical ends M. Then the restriction map C^{M) C^{Z) 

extends to a continuous map H^{M) — > H^~^^‘^{Z), for any s > 1/2. 



4. Layer potentials depending on a parameter 

The aim of this section is to investigate the invertibility of layer potential 
operators which depend on a parameter r G M, via a method initially developed 
by G. Verchota in [27], for the case of the fiat-space Laplacian. The novelty here 
is to derive estimates which are uniform with respect to the real parameter r. 

Let M be a smooth, compact, boundaryless Riemannian manifold, and fix a 
reasonably regular subdomain Q C M (Lipschitz will do). Here, M will play the 
role of the boundary dMi of a manifold with boundary Mi (in our standard nota- 
tion Ml is used to define manifolds with cylindrical ends). Anticipating notation 
introduced in the next section, Q will play the role of the exterior of X. 

Set V for the outward unit conormal to Q and da for the surface measure on dLt 
(naturally inherited from the metric on M). The departure point is the following 
Rellich type identity (cf. the discussion in [16]): 



(4.1) [ {iy,w){\Vtanu\‘^ - da 

Jan 

J djyU da 2Re J {Vu,w)AMudx 

+ Re / {{diYw)\Xu\^-\-2{Cw9){'^u,\/u)]dx, 



2Re 



which is valid for a (possibly complex- valued) scalar function u and a real- valued 
vector field w (both sufficiently smooth, otherwise arbitrary) in Q. Here, Cyjp 
stands for the Lie derivative of the metric tensor g with respect to the field w, and 
the subscript ‘tan’ denotes the tangential component relative to dGt. 
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Another general identity (itself a simple consequence of the divergence theo- 
rem) that is useful here is 

(4.2) f \uf{w,iy) da = Re / {2u{Vu,w) (dW w)\u\‘^} dx. 

Jdn Jn 

To proceed, fix a non- negative scalar potential W G C^{M) and for the 
remainder of this subsection assume that 

(4.3) (Am + + W)u = 0 in 0, 

where r G R is an arbitrary parameter (fixed for the moment). Our immediate 
objective is to show that 

(4.4) f \d,,ufd(T<C [ {|VtanM|^ + (1 +'T^) 

J dQ J do, 

uniformly in r, and that for each e > 0 there exists a finite constant C = > 

0 so that 

(4.5) f {\^tsinu\^ -\- da < C f \dj,uf da e f \u\‘^ da 

J dO. J do, J 

uniformly in the parameter r G R. We shall also need a strengthened version of 
(4.5) to the effect that 



(4.6) 



> 0 in n : 



[ {|VtanMp + (1 + 'T^) < C / \d„uf 

J dQ J dQ 



da 



uniformly in the parameter r G R. 

With an eye on (4.5), let us recall Green’s first identity for the function u that 
we assumed to satisfy Eq. (4.3) 



uda, 



f {\Vu\^ d- r^\u\‘^ W\u\‘^} dx = Re f udi 
Jn Jdn 

which readily yields the energy estimate 

(4.7) f {|Vwp + dx < f \u\\di,u\da. 

Jn Jdn 

In turn, this further entails 

(4.8) f T‘^\Vu\\u\dx < C\r\ f {r^\u\^ -\-\Vu\^} dx <C\r\ f \u\\di,u\ 

Jn Jn Jon 

uniformly in r. 

Let us now select w to be transversal to i.e. 

(4.9) ess inf {w, u) > 0 on 

something which can always be arranged given that dQ is assumed to be Lipschitz. 
This, in concert with (4.2), then gives 



da. 



(4.10) 



f \u\‘^da<C f {\u\‘^ \Vu\\u\} dx. 

Jan Jn 
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Multiplying (4.10) with and then invoking (4.7)-(4.8) eventually justifies the 
estimate 

(4.11) [ da < C [ {1 \r\)\duu\\u\da. 

Jan Jan 

Next, we make the (elementary) observation that for every > 0 there exists 
C = C{e, ^) > 0 so that 

(4.12) (1 + lr|) \duu\ \u\ < + C \dj,u\^ + ^\u\^ , 

uniformly in r. When considered in the context of (4.11), the boundary integral 
produced by the first term in the right side of (4.12) can be absorbed in the left 
side of (4.11), provided 8 is sufficiently small. Thus, with this alteration in mind, 
(4.11) becomes 

f r‘^\u\‘^ da < C f \di,u\^ da + e f \uf da^ 

Jan Jan Jan 

which is certainly in the spirit of (4.5). In fact, in order to fully prove the latter 
estimate, there remains to control the tangential gradient in a similar fashion. To 
this end, observe that (4.9) and Rellich’s identity (4.1) give 

[ I Vtan^P < (7 f Idjyul"^ da C f r‘^\Vu\\u\dx C ( \Vu\^ dx, 

J 50 J an J n J n 

uniformly in r. With this at hand, the same type of estimates employed before 
can be used once again to further bound the solid integrals in terms of (suitable) 
boundary integrals. The bottom line is that 

(4.13) [ |Vtan^Pdcr<C I \di,u\‘^ da s j \u\‘^ da, 

Jan Jan Jan 

uniformly in r, and (4.5) follows. 

It is now easy to prove (4.6), having disposed off (4.5). One useful ingredient 
in this regard is 



(4.14) 



f \u\^ dx < C j {\Vu\^ + W\u\^} dx, 

Jn Jn 



itself a version of Poincare’s inequality. When used in conjunction with (4.7) and 
(4.10), this readily yields 



I da 



(4.15) [ \u\^ da<C [ {\Vuf + W\u\^} dx < C f \d^i 

Jan Jn Jan 

so that, ultimately, 

(4.16) f \u\‘^ da < C f \djyu\‘^ da, 

Jan Jan 

in the case we are currently considering. In concert with (4.5), this concludes the 
proof of (4.6). Let us now turn our attention to the estimate (4.4). For starters, 
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Rellich’s identity (4.1) can also be employed, along with the condition (4.9), to 
produce 

(4.17) / \d^ufda<C [ \Vte.nu\‘^ da + C [ T^\Vu\\u\dx + C [ \Vu\'^ dx, 

JdQ Jdvt Jn Jn 

uniformly in r. Then, much as before, 

j {r^|Vn| |i£| + I V7i|^} dx < C f {1 \t\) \djyu\\u\ da 
Jn Jdn 

(4.18) < S f \di,u\‘^ da C f (1 + r^) da, 

Jdn Jdn 

where d > 0 is chosen small and C depends only on O and 6. With these two 
estimates at hand, the endgame in the proof of (4.4) is clear. 

After these preliminaries, we can finally address the main theme of this sub- 
section. More concretely, for each r G M, let 5r, Kr be, respectively, the single and 
the double layer potential operators associated with Am + + W on dVt. From 

the work in [ 16 ] , it is known that if Q has a Lipschitz boundary then both 

Sr : L^{d9) -> H\d^) and \l^Kr'. L^{d9) -> L^{d9) 

are invertible operators for each r G M. Our objective is to study how the norms 
of their inverses depend on the parameter r. To discuss this issue, for each r G M 
and / G set 

(4-19) ||/l|Hi(ao) WfWmidQ) + kl ll/llL2(ao). 

Thus, M 3 r 1 -^ II • ||//i(ao) is a one-parameter family of equivalent norms on the 
Sobolev space A natural way to come up with this family of seminorms is 

by studying the Sobolev spaces on x M). The main result of this subsection 

is as follows. 

Proposition 4.1. Assume that is a fixed, Lipschitz subdomain of M. Then 
there exits a finite constant C = C(dft) > 0, depending exclusively on the Lipschitz 
character of O, such that for each r G M, we have 

(4-20) ||5“VllL2(aQ) < C||/||j/i(af2) 

uniformly for f G H^(dfl). 

Furthermore, if W > 0 on a set of positive measure in fl, then for any r G R 
we also have 

(4.21) \W + Krr'f\\LHau)^C; ll/llL2(an), 
uniformly for f ^ LA {dTt ) . 

Proof. Consider first (4.21). Let := Q, M \ 0. For / G LA{d^), 

set u Sf in 0±. Thus, 

(4.22) (U)+ = («)_, (Vtan«)+ = (VtanU)-, (3.u)± = (±4/ + M) /• 
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In turn, (4.22), (4.4) and (4.6) allow us to write 

+ = |l(a,w)_||i2(an) < C||(w)_|Uj(an) 

= C||(«)+|U.(an)<C||(a.«)+|U.(ao)=C||(i7 + K:)/||^,(g„). 

Consequently, 

(4.23) ||/|U.(a^,) < |l(-^i + ^;)/|L.(9«) + ||(i/ + ^^)/|L.(an) 

<^IKI^ + -^:)/IL=(an) 

for some constant C = C{dD,) > 0 independent of r. Going further, if C{X) := 
C{X, X), the normed algebra of all bounded operators on a Banach space X, then 
(4.23) entails 

11 ( 2 / + Kr) \\c(L^{dn)) ~ 11^2^ + ^r) ||£(L2(aLi)) - 

This takes care of (4.21). 

As for (4.20), the argument is rather similar, the main step being the derivation 
of the estimate 

WfhHdn) < C \\Vt.n{Srf)\\man) + C^(l + |r|) \\Srf\\man). 
out of (4.22) and (4.4), when the latter is written both for and Once 
again, the crux of the matter is that the intervening constant C = C{dQ) > 0 is 
independent of r. The proof is finished. □ 

See also [28, 29]. 



5. The Dirichlet problem 

We now apply the results we have established to solve the inhomogeneous 
Dirichlet problem on manifolds with boundary and cylindrical ends. 

The class of manifolds with boundary and cylindrical ends that we consider 
have a product structure at infinity (including the boundary and the metric). It 
is possible to relax these conditions, but for simplicity we do not address this 
technical question in this paper. 

Definition 5.1. Let X be a Riemannian manifold with boundary dN. We 
shall say that X is a manifold with boundary and cylindrical ends if there exists 
an open subset R of X isometric to (— oo,0) x X, where X is a compact manifold 
with boundary, such that X \ is compact. 

Lemma 5.2. Let N be a Riemannian manifold with boundary dN. Then N is a 
manifold with boundary and cylindrical ends if, and only if, there exists a manifold 
with cylindrical ends {without boundary) M with a standard decomposition 

M = Ml u{dMi X (- 00 , Oj) 
and containing N such that 

Nn{dMi X (- 00 , Oj) = X X (-00,0], 
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for some compact manifold with boundary X C dMi . 

Let M and N be as above. We define H^{N) to be the space of restrictions to 
N of distributions u e H^{M) (see also [2]). We want to prove that the map 

(5.1) H^{N) (AAfM,wlaiv) G 

is an isomorphism for s > 1/2. 

Proposition 5.3. Assume that the potential V is chosen so that V is not 
identically zero on dM\ \ X. Then the map A- X* : L?(dN) — > L‘^{dN) is 
injective. 

Proof. Just follow word for word [16, Proposition 4.1]. □ 

Note that our signs are opposite to those in [16] or [26], because we use the 
definition that makes the Laplace operator positive. 

To prove the Fredholm property of the operators A- K and A- we 
need to slightly change the corresponding argument in [16]. 

Proposition 5.4. Retain the same assumptions as in Proposition 5.3. Then 
the operator 

(5.2) -\I + K-. L^{dN) L^{dN) 
is Fredholm of index zero. 

Proof. The above proposition is known when M is compact ([16, Corol- 
lary 4.5]). To check that the operator in question is Fredholm, we shall rely on (iv) 
in Theorem 2.1, which amounts to studying the associated indicial family. 

Let W := VdMi and T = (Am + Recall that K := Tqn and that 

dN ~ dX X (—00,0] in a neighborhood of infinity. Then Proposition 3.3 gives 

(5.3) k{T) = fW(r) = [f{r)]ax = [(A^m, + + W)~^d:]ex = 

where is the double layer potential operator associated with the perturbed 
Laplacian A^Mi + + W on dX (cf. the discussion in §3.3). 

Our result is then true pointwise, because of the result on compact manifolds. 
We only need to prove that it is uniform in r. This can be achieved as in the 
previous section, or by using [21, Theorem 9.2]. □ 

Corollary 5.5. Let V be as before. Then the operator 
-\I + K: H%dN) H^{dN) 
is invertible for each 5 G M. 

Proof. To begin with, the case s = 0 is easily proved by putting together the 
above two propositions. In particular, the operator —^lA~K: H^{dN) — > H^{dN), 
in the statement of this corollary, is injective for each s > 0. Since the fact that 
this operator is also surjective is a consequence of the corresponding claim in the 
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case s = 0 and the elliptic regularity, the desired conclusion follows for s > 0. As 
for the case s < 0, a similar reasoning shows that 

(5.4) -i/ + K* : H~^{dN) H~^{dN) 

is invertible for each s < 0. This and duality then yield the invertibility of — ^ / + 
K : H^{dN) — ^ H^{dN) for s < 0, as wanted. □ 

Another proof of the above result can be obtained from Theorem 2.4, for the 
case m = 0, the “easy one.” 

After these preliminaries, we are finally in a position to discuss the following 
basic result. 

Theorem 5.6. For any s > 0 and any f G H^{dN), there exists a unique 
function u G such that u\on = f A^u = 0. 

Proof. Fix a potential V which is not identically zero on dMi\X, yet V = 0 
near X. In particular, the conclusion in Corollary 5.5 holds. First we claim that 

(5.5) V: H^{dN) ^ seR, 

is well-defined and bounded. Indeed, if s < 0, then this is a consequence of the 
implication 

(5.6) / G H^{dN), s<0 f^SsN € 

along with the factorization V{g) = (Am + V)~^d*{g ® Son)- For s = 0, one can 
employ the techniques of [ 18 ]. The case s > 0 then follows inductively from what 
we have proved so far with the aid of a commutator identity which essentially 
reads Wf = P(Vtan/) + lower order terms; see (8.19) in [ 17 ] as well as (6.17) in 

[18]. 

Having disposed off (5.5) the existence part in the theorem is then easily 
addressed. Specifically, if s > 0, consider g := (— + A")“^/ G H^{dN) and then 
set u := V{g) G by (5.5). □ 

We are now ready to prove Theorem 0.2 

Proof. The continuity of the map An follows from the continuity of the map 
An’ H^{N) and from the continuity of the trace map H^{N) — > 

As before, we fix a potential V which vanishes in a neighborhood of N. Let 
g G be arbitrary. First extend ^ to a distribution (denoted also g) in 

i7"-2(M), then set m - (A + V)~^g G H^{M) and /i - ui\qn e 
Finally, choose G H^{N) such that AnU 2 = 0 and U 2 \dN — f — fi- Then u ;= 
ui + U 2 satisfies Anu = g and u\qn — f • This proves the surjectivity of A^v- The 
injectivity of this map then follows from the uniqueness part in Theorem 5.6. □ 

It is likely that some versions of the above two theorems extend to weighted 
Sobolev spaces. This will likely requires techniques similar to those used in [5]. 
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5.1. The Dirichlet- to- Neumann map. Theorem 5.6 allows us to define 
the Dirichlet- to- Neumann map J\f 

MU) = {d^u)+ 

for / G L‘^{dN) and u solution of Anu — 0, u\on — /• 

Theorem 5.7. Let N he a manifold with boundary and cylindrical ends. Then 
the operator S : H^(dN) — > is invertible for any s and (|7 + K*^ S~^ = 

J\f, the ‘^Dirichlet- to- Neumann map.” In particular, J\f G 

Proof. The operator S is elliptic by Proposition 3.5. For further reference, 
let us note here that 

(5.7) / G H^{dN) kSf e H^^\dN) f G 

by elliptic regularity. 

Next, using the notation of Proposition 4.1, we have S{r) — Sr- By the results 
of the same proposition, S{r) is invertible for any r, and the norm of the inverse 
is uniformly bounded (this can be proved also by using the results of [16] or [18] 
and the estimates in [ 21 ]). Consequently, S: H^{dN) — > is Fredholm 

(cf. Theorem 2.1). Checking that S is injective when s = 0 is done much as in the 
last part of §6 in [16]. □ 

Corollary 5.8. The Cauchy data space 

{{u\9M:d,u\dN);ueH%N)} 

is a closed suhspace of 0 for any s > 1/2. 

We conclude this section with yet another integral representation formula for 
the Dirichlet problem. 

Corollary 5.9. Retain the usual set of assumptions. Then, for each s > 0, 
the solution to the boundary problem 

u e Anu = 0, «|a;v = / G HUdN), 

{see Theorem 5.6) can also be expressed in the form u = S{S~^f) in N. 
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Vladimir Nazaikinskii and Boris Sternin 



Abstract. This paper is a review of relative elliptic theory (i.e., elliptic 
theory in the category of smooth embeddings) closely related to the Sobolev 
problem, first studied by Sternin in the 1960s. We consider both analytic 
aspects of the theory (the structure of the algebra of morphisms, ellipticity, 
Fredholm property) and topological aspects (index formulas and Riemann- 
Roch theorems). We also study the algebra of Green operators arising as a 
subalgebra of the algebra of morphisms. 



Introduction 

1. By relative elliptic theory we mean elliptic theory associated with a pair 
(M, X), where M is a smooth closed manifold and X a submanifold. Thus, relative 
elliptic theory is elliptic theory in the category of smooth embeddings. 

A trivial (and non-interesting) example of a relative elliptic operator is given 
by a pair of elliptic operators on the manifolds M and X, respectively. Such an 
operator can be represented in the form of a diagonal matrix operator 

(D^ 

with elliptic (pseudodifferential) operators Dm and Dx acting, say, in Sobolev 
spaces on M and X. 

This trivial example, however, suggests that in the general case a relative 
elliptic operator should apparently be represented by a matrix of the form 

(Dmm Dmx\ 

^ ^ \Dxm Dxx) 

(where the subscripts show, from the right to the left, the direction of action of the 
corresponding operators), which is not necessarily diagonal. First, we note that a 



2000 Mathematics Subject Classification. Primary: 58J05; Secondary: 58J20, 58J32, 58J40. 
The work was supported by the DFG via a project with the Arbeitsgruppe “Partielle Differ- 
ent ialgleichungen und Komplexe Analysis,” Institut fiir Mathematik, Universitat Potsdam and 
by RFBR grants 03-02-16336, 02-01-00118, and 00-01-00161. 



495 




496 



V. NAZAIKINSKII AND B. STERNIN 



posteriori this guess proves to be true. However, it deserves a serious explanation. 
Indeed, the operators Dmx and Dxm^ representing the off-diagonal entries of this 
matrix, act from a function space on one manifold to a function space on another 
manifold and hence, unlike Dmm and Dxx, are by no means pseudodifferential 
operators, at least if the term is understood in the classical sense. Thus, what is 
the nature of these operators? 

Let us try to find some candidates for these operators. First, consider the op- 
erator Dxm- This operator acts from a function space on M into a function space 
on the submanifold X. The most natural operator of this kind is the restriction 
operator (or boundary operator) induced by the embedding i: X ^ M. If one 
requires the set of operators of the form (0.1) be invariant with respect to the 
passage to the adjoint operator, then the operator Dmx must be the adjoint of 
Dxmi Ifiat is, the operator of co-restriction, or, as it will be called in what follows, 
the coboundary operator. Thus, at first glance, our would-be theory is the theory 
of operators of the form 



( 0 . 2 ) 



Dmm 



D, 



where i* and z* are the boundary and coboundary operators and Dmm and Dxx 
are pseudodifferential operators on the corresponding manifolds. Unfortunately, 
operators of the form (0.2) do not form an algebra, which is a serious disadvantage 
from the viewpoint of elliptic theory. Indeed, the proof of the Fredholm property 
of an elliptic operator is carried out in the most convenient and natural form 
by constructing so-called regularizers, that is, almost inverses (inverses modulo 
compact operators). To apply this method, one must have the structure of an 
algebra on the set of operators and an effective calculus. 

Why do the operators (0.2) not form an algebra? 

A straightforward multiplication of two matrices of the form (0.2) shows that 
if we wish the matrices in question to form an algebra, we must first of all extend 
the class of (co)boundary operators. For example, instead of the (elementary) 
restriction operator i* occurring in (0.2), one should consider a general boundary 
operator of the form and the elementary coboundary operator z* 

should be replaced by a general operator of the form 

However, the main cause is essentially that the upper-left corner of the prod- 
uct of two operators of this type contains an operator of entirely different structure 
than a pseudodifferential operator. This is not surprising, since the factors occur- 
ring in this operator are not pseudodifferential operators.^ Thus, it seems natural 
to extend the class of operators in the upper-left corner so that it will include not 
only pseudodifferential operators, but also operators of the form 

D'MM^^Dxxi'' D'mm 



^Note, however, that the similar entry in the lower-right corner of the product is still a 
pseudodifferential operator. 
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(and sums of such operators), which occur in compositions. (It is remarkable that 
now, after an appropriate closure, the set of operators becomes closed with respect 
to composition, which in principle solves the problem of constructing a calculus.) 

This important class of operators, which does not occur in the original state- 
ment, is the class of Green operators. These operators inevitably occur as products 
of boundary and coboundary operators as well as in the construction of an almost 
inverse operator in the Sobolev problem. (See point 2 below of this Introduction.) 
Similar operators (also known as Green operators^) arise in the theory of bound- 
ary value problems as well as in elliptic theory on manifolds with singularities 
(e.g., see [Mon71, Sch91]). In the present paper, we naturally discuss only Green 
operators associated with the pair (M, X). Green operators, as well as pseudodif- 
ferential operators, form an algebra: The product of two Green operators is itself 
a Green operator. In contrast with the algebra of pseudodifferential operators, the 
Green algebra is an algebra without unit: The identity operator is not a Green 
operator. One can attach the unit in the standard way and consider the inversion 
problem for operators of the form 1 + T, where T is a Green operator, in the 
extended algebra. In other words, one studies the solvability of the equation 

(0.3) (l-hT)u = / 

for an unknown function u on M, where / is a given function on M. Equation (0.3) 
will be called the Green equation of the second kind. It is of considerable interest 
owing to the fact that the operator 1 -f T occurs in the ellipticity conditions for 
general operators associated with the pair (M, X). 

The algebra of operators of the form “a pseudodifferential operators plus a 
Green operator” is just one possible extension of the algebra of pseudodifferential 
operators on M. Such extensions arise in the presence of some additional structures 
on M (in our case, the additional structure is the embedded submanifold X). 
Other examples of extensions (not covered in this survey) can be found in [SS92a, 
SS92b, SS94]. 

However, this is not the whole story. It is desirable to describe the newly intro- 
duced operators in known terms. Such a description would certainly be some kind 
of good luck, since it might well happen that these operators are of absolutely new 
nature unknown in the literature. Fortunately, this is not the case. These operators 
can be interpreted 8 ls Fourier integral operators on special Lagrangian manifolds. 
In this interpretation, each type of operators (boundary, coboundary, etc.) corre- 
sponds to its own Lagrangian manifold. These operators admit also an adequate 
interpretation in quite different terms in a neighborhood of the submanifold X. 

^In fact, Green operators arise even in the simplest boundary value problems such as the 
Dirichlet problem with non- zero right-hand side / for the Laplace operator in a domain. One 
reduces this problem to a problem with zero right-hand side by subtracting the convolution of 
/ with the Newtonian potential from the solution and then expresses the solution of the new 
problem as the simple layer potential corresponding to the resulting boundary conditions. The 
simple layer potential with density equal to the restriction to the boundary of the convolution 
of the right-hand side with the Newtonian potential is just the simplest Green operator applied 
to /. 
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Namely, they can be represented as a special class of pseudodifferential opera- 
tors acting in sections of infinite-dimensional bundles over X (pseudodifferential 
operators with operator- valued symbols). 

2. Relative elliptic theory allows one to solve an important, interesting prob- 
lem in the theory of partial differential equations, known as the Sobolev problem. 

To illustrate how the Sobolev problem arises, we consider simple physical ex- 
amples. Suppose that we push a soap film spanning a one-dimensional contour 
with a thin needle. In the case of perfect non- wetting, the film collapses immedi- 
ately unless we actually only touch it not trying to change its shape. In the case 
of perfect wetting, the needle passes through the film, whose shape remains un- 
changed. However, if we push a plate with the same needle, then the plate shape 
changes. In other words, one cannot pose “boundary conditions” for the thin film 
equation at a single point, but such conditions are possible for the plate equation. 

Mathematically, this can be described as follows. 

The function z = z{x,y) describing the shape of a thin two-dimensional film 
spanning a closed one-dimensional contour {z — (p{x,y) | (x,y) € F} in the space 
satisfies the Dirichlet problem 



(0.4) 



Az = 0, 

^Ir = ^ 



in the domain D C MS bounded by the plane curve F. Let us try to support the 
film with a thin needle at a point (a:o, yo, zq) G under the assumption of perfect 
non-wetting. Then the equation in problem (0.4) must be satisfied everywhere in 
D except for the point {xQ,yo): 



(0.5) 



Az = 0 mod (rro,yo)- 



(This notation means that the distribution Au is supported at the point (xq, yo).) 
Next, we must equip problem (0.4) with the additional boundary condition 



(0.6) 



{xQ.yo) 



By the well-known removable singularity theorem for harmonic functions, every 
solution of the equation (0.5) in D bounded at the point (xq, yo) (the boundedness 
of z{x,y) follows from (0.6)) is a harmonic function everywhere in D including 
the point (xq, yo) so that the value z(xq, yo) is uniquely determined by the data of 
problem (0.4). Hence problem (0.5)-(0.6) is not solvable unless zq is equal to the 
value of the solution of problem (0.4) at that point. 

In the case of perfect wetting, the equation in problem (0.4) still holds in 
D \ {(xo,?/o)}, but no additional conditions are imposed at the point (xo,yo)- By 
the removable singularity theorem, the problem 



Az = 0 mod(xo,yo), 

^Ir = ^ 
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is equivalent to problem (0.4), which means that the needle passes through the 
film without changing the film shape. 

The situation is entirely different for the elastic plate problem 



(A‘^z = 0, 



dz 

Bn r 






Here d/dn is the outward normal derivative on F. If we replace the equation in 
this problem by the equation 



(0.7) 



A^z = 0 mod (xo,yo)5 



then an additional condition of the form (0.6) is admissible, since Eq. (0.7) has 
a non-trivial continuous solution behaving as r^lnr near {xQ,yo), where r is the 
distance to that point. 

Thus, we see that for equations of sufficiently high order one can pose problems 
involving “boundary conditions” on manifolds of codimension higher than one. 
Problems with such conditions are called Sobolev problems. The general statement 

of the Sobolev problem is as follows. Let X ^ M he a. smooth embedding and D 
an elliptic differential operator on M. Consider the equation 



(0.8) Du = / mod X, 

which means that Du = f everywhere on the manifold M except for the submani- 
fold X. The problem is to equip Eq. (0.8) with well-posed boundary conditions on 
X. (Well-posedness is understood in the sense that the problem must be Fredholm.) 
Next, we wish to compute the index of the problem. Note that Sobolev [Sob37] 
was the first to consider such a problem for the polyharmonic equation; he used 
variational methods to prove the unique solvability of the problem in this case. 
The general statement and analysis of this problem, as well as the term “Sobolev 
problem,” is due to Sternin [Ste64] (see also [Ste66]). 

Note that Sobolev problems have a number of properties distinguishing them 
from ordinary elliptic boundary value problems for differential equations. 

For example, the number of boundary conditions in these problems depends 
on the index of the Sobolev space in which the solution is to be sought. In partic- 
ular, the Sobolev problem is essentially trivial in the space of sufficiently smooth 
functions, since relation (0.8) turns into an equality everywhere and no boundary 
conditions on X are needed. Next, the solution of an elliptic Sobolev problem is not 
an infinitely smooth function in general even if the right-hand side of the equation 
is infinitely smooth. The solution can have singularities on the submanifold X. 

3. Relative elliptic theory associated with the pair (M, X) gives rise to re- 
markable relationships between elliptic pseudodifferential operators on M and X. 
These relationships were studied from the topological viewpoint for the first time 
by Novikov and Sternin [NS66a, NS66b] and later by Sternin in the book [Ste71]. 
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Associated with the embedding X ^ M is the natural pullback 

il^-.K{T*M)^K{T*X) 

in the topological A-functor, as well as the analytically defined metric trace 

4: PSD(M) -^PSD(X) 

and pullback 

i[: PSD(M) — ^PSD(X), 

which take pseudodifferential operators on M to pseudodifferential operators on 
X. (The first of the latter mappings is defined by the metric-dependent restriction 
of the symbol to the conormal bundle of the submanifold X, and the second is 
given by the formula 

where i* and i* are the boundary and coboundary operators.) Hence there is a nat- 
ural problem of comparing the corresponding functors, i.e., establishing Riemann- 
Roch type theorems. It turns out that such theorems are valid indeed. The simplest 
theorem compares the metric trace and the topological pullback and states that 
the diagram 

Ell(M) > Ell(X) 



K{T*M) — . X(T*X), 

Hop 

where the vertical arrows are given by the difference construction for the princi- 
pal symbol, commutes. Similar theorems comparing the analytic and topological 
pullbacks are valid in the context of meromorphic families of elliptic operators or 
for the regularized pullback^ 

as Rez oo. 

However, there is an important class of operators for which the “infinite” 
regularization is not needed. This is the class of first-order differential operators, 
which in particular includes all main geometric operators. Nor is the infinite reg- 
ularization needed in the statement of the theorem comparing the analytic and 
topological pullbacks for operators whose structure in a neighborhood of X is that 
of the exterior tensor product [AS63] of an elliptic operator on X by a family of 
elliptic operators in the fibers of the normal bundle. This structure is also typical of 
geometric operators and permits one to compute the pullback for these operators 
explicitly. 

^Here A stands for an invertible operator whose principal symbol coincides with that of the 
Laplace operator. 
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4. Let us briefly outline the exposition of this survey. In the first part, we 
develop the relative theory of pseudodifferential operators as a theory associated 
with a smooth embedding X ^ M. In the framework of this theory, we introduce 
the notion of ellipticity and establish the theorem on the Fredholm property. The 
index formula for relative elliptic operators (elliptic morphisms) is proved. By way 
of example, we develop the theory of Sobolev problems, prove the Fredholm prop- 
erty, and compute the index. Furthermore, we introduce and study the algebras 
of Green operators associated with the embedding X ^ M, prove a criterion for 
the Fredholm property of the Green equation, and apply the result to the analysis 
of conditions for the Fredholm property of general elliptic morphisms. The second 
part deals with the topological aspects of elliptic theory in the category of smooth 
embeddings and establishes the facts described in item 3 above. As an example, 
we consider the Euler, Dirac, Hirzebruch, and Todd (Cauchy-Riemann) operators. 

5. The present paper develops ideas, methods and results contained in [Ste64, 
Ste66, Ste67, Ste76, SS96, NS66a, NS66b, Ste71]. In particular, it gives a 
new glance on classical elliptic Sobolev problems and relative elliptic theory from 
the viewpoint of modern theory of differential equations. For example, boundary 
and coboundary operators, as well as Green operators, are interpreted in terms of 
Fourier integral operators. 

As one can see from the cited literature, the first papers on general Sobolev 
problems were written about forty years ago (see [Ste64, Ste66]). Since then, 
quite a few remarkable papers on relative elliptic theory have been published. The 
notion of a coboundary operator, originally introduced in [Ste67], is nowadays 
widely used in general theory of differential equations. In various situations, many 
authors independently developed constructions close in their spirit to the con- 
structions of relative elliptic theory (e.g., see [VE65a, VE65b, Esk73, Mon71, 
Sch91], etc.). 

Conventions and notation. Let us make some remarks concerning conventions 
and assumptions adopted throughout the text. The dimension of the submanifold 
X will always be denoted by n and the codimension by i/ (i.e., dimM = n + z/). For 
convenience, we everywhere assume that the manifolds M and X are equipped with 
some given volume elements (IvoIm and dvolx so that one need not distinguish 
between functions and densities. Whenever we deal with Sobolev spaces of sections 
of a vector bundle^, we assume that a Hermitian structure is given in the fibers, so 
the the inner product of sections is well-defined and one can identify function 
sections and density sections. All these assumptions do not restrict the generality. 

Many of our considerations are carried out in local coordinates on X or M in 
a neighborhood of some point xq G X. We always assume that these coordinates 
are chosen in the following special way. A special coordinate system on X is a 
coordinate system (xi, . . . , such that 

dvolx = dxi . . . dxn- 

^Such spaces are considered here only for complex vector bundles 
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A coordinate system (xi, . . . , ti, . . . , on M near X is called a special coor- 
dinate system if 

(1) the equations of the submanifold X have the form 

= • • • = = 0; 

(2) for t = 0, the system (xi, . . . , Xn) is a special coordinate system on X\ 

(3) one has 

d voIm = dxi . . . dxn dti . . . dtn- 

There always exist coordinate systems with these properties. We usually as- 
sume that M and X are Riemannian manifolds with metrics pm and px , respec- 
tively, the embedding is isometric, and the volume elements correspond to the 
metrics. Then one can construct a special coordinate system on M as follows. Let 
7 t: NX — > X be the normal bundle of X in M, i.e., the orthogonal complement 
of the tangent bundle TX C TM\^. We introduce local coordinates {x, t) on NX, 
where x — {xi, . . . ,Xn) is a special coordinate system on A in a neighborhood of 
Xq and t = (ti,...,tiy) are linear coordinates in the fiber N^X with respect to 
some orthonormal basis smoothly depending on a: G A in a neighborhood of xq. 
The exponential mapping 

exp: NX M, 

^ ^ 7?(1), 

where 7^(r) is the geodesic on M issuing from the point Tr(^) with initial velocity 
vector 7^(0) = dilfeomorphically maps some neighborhood V of the zero section 
of the normal bundle onto a tubular neighborhood 17 of A in M. (In the following, 
we identify U with V.) In a neighborhood of a given point xq G A, one can take 
the coordinates {x,t) on M transferred by the exponential mapping from NX. 
Then the submanifold A is given in these coordinates by the equation {t = 0}, 
and 

V 

pM - Px + dtp [(/voIm] = dvolx dti... dti,. 

By multiplying t\ by a non-zero smooth function equal to 1 for t — 0, we ensure 
that the second equation holds not only on A, but everywhere. 

The coordinates dual to x (respectively, {x,t)) in the fiber of the cotangent 
bundle will be denoted by p (respectively, (p, r)), p G R^, r G M^, and the coordi- 
nates (x,p) (respectively, {x,t,p,r)) will also be referred to as special coordinates 
on the cotangent bundle. For example, the symplectic forms on T*M and T*A 
are given by the expressions 

n u 

lom = dp /\ dx -\- dr f\ dt = dpj A dxj -h ^ dxj A dtj , 

j=i j=i 

n 

ujx = dp A dx = ^ dpj A dxj 
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in special coordinates. 

To avoid cumbersome formulas, we also make the following simplifying as- 
sumptions, which are not important for the validity of the main results. 

• All operators considered in the first part of the paper (except for the 
section concerning Sobolev problems) act in function spaces (the gener- 
alization to the case of operators acting in spaces of sections of vector 
bundles is standard). 

• The manifolds M and X are assumed to be oriented. Moreover, we use 
only special coordinate systems coordinated with the orientation so that 
the Riemannian volume elements d vo\m and d volx on M and X can be 
treated as ordinary differential forms of maximal order on these mani- 
folds. 
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fessor B.-W. Schulze for his kind hospitality. The authors also wish to thank the 
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Analytic Aspects of Relative Elliptic Theory 



Let M be a smooth compact manifold without boundary and X ^ M a closed 
smooth submanifold. In this part, we define and study elliptic morphisms associ- 
ated with the pair (M, X). These morphisms act in pairs of Sobolev spaces on M 
and X. The main tool in their construction is the technique of Fourier integral op- 
erators (briefly recalled in the Appendix) , and our exposition follows the standard 
semiclassical quantization scheme: We first introduce classical objects associated 
with the pair (M, X) (Lagrangian manifolds with measure and symbol classes) 
and then describe the quantization procedure, which produces the operators that 
are elements of the morphism algebra, and establish its main properties, i.e., for- 
mulas for the product of operators and the adjoint operator. Next, we use these 
properties to state ellipticity conditions for morphisms, prove a theorem on the 
Fredholm property, and prove an index formula for elliptic morphisms. Finally, the 
results are applied to the Sobolev problem. 

We note that the Lagrangian manifolds used in the construction of the mor- 
phism algebra do not satisfy the fundamental condition A.l (see the Appendix), 
which is assumed in general in the theory of Fourier integral operators. Namely, 
three of these manifolds have a non-empty intersection with the zero section of 
at least one of the cotangent bundles in the Cartesian product of which they lie. 
Hence the general composition and boundedness theorems (see Subsections A. 6 
and A. 7) are not valid for such Fourier integral operators, and we have to intro- 
duce some modifications in the statements of definitions and theorems. Moreover, 
one encounters three new phenomena. 

(1) The operators in question prove not to be continuous in the entire Sobolev 
scale. For example, the restriction operator 

is well-defined and continuous only for s > and is undefined other- 
wise. 

(2) Products of Fourier integral operators are not always well-defined. For 

example, the product where is a pseudodifferential operator on 

X, is defined only for ordD < —u (and is meaningless, say, for D = 1: 
the coboundary operator produces the delta function concentrated on 
X, whose restriction to X is not defined). Hence one has to introduce 
restrictions on the orders of the operators to be considered. 

(3) One hcLS to deal with symbol classes determined by estimates that are 
more complicated than the estimates (A. 3), customarily used in the gen- 
eral theory (see the Appendix). Such symbols inevitably arise from the 
multiplication of operators even if the symbols of the factors satisfy (A. 3). 
For example, the product $ = Dxi*Dm^ where Dx and Dm are pseu- 
dodifferential operators of the form 



Dx ^ a 



dx 



Dm — b 



dx' dt) 
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on X and M, respectively, has the symbol a{p')b{p' ,r') on the corre- 
sponding Lagrangian manifold. The differentiation of this symbol with re- 
spect to p' does not change the rate of growth as |r'| ^ oo for bounded p'. 



1. Classical objects. Lagrangian formalism 

1.1. Lagrangian manifolds with measure. Let 

( 1 . 1 ) i:X^M 

be a embedding of a closed smooth manifold X in a closed smooth manifold M. 
Associated with the pair (M, X) are five remarkable E+ -homogeneous Lagrangian 
manifolds 

LM,LqC T^M X T*M, Lx C T*X x T*X, 

( 1 . 2 ) 

^ Lb C T*X X T*M, Lc C T*X x T*X 

in Cartesian products of cotangent bundles. Furthermore, these manifolds are 
equipped with natural measures. All these manifolds can be obtained by the same 
recipe: One takes the conormal bundle of a certain submanifold in the product of 
bases of the corresponding cotangent bundles and reverses the sign of the momen- 
tum variables in the second factor. (Note that this change of sign automatically 
transforms the conormal bundle into a Lagrangian manifold with respect to the 
difference of symplectic forms on the first and second factors.) Let us describe the 
Lagrangian manifolds (1.2). 

1.1.1. The manifolds Lm and Lx- 

Invariant description. These manifolds are trivial in the sense that they are 
independent of the embedding and are related to M and X separately. They can 
be obtained by the above-mentioned construction from the diagonals 

Am = {(a, l3)eMxM\a = P}cMxM, 

Ax = {{a, (3) eXxX\a = /3}cXxX 
in M X M and X x X, respectively. Thus, 



Lm = N*{Am) C T*M X r*M, Lx = N*{Ax) C T*X x T*X, 

Here N*{Y) is the conormal bundle of Y and the tilde on N* stands for reversing 
the sign of the cotangent variable in the second factor T*M (or T*X). One can 
readily see that the manifolds Lm and Lx themselves are diagonals in products 
of cotangent bundles, i.e., the graphs of identity canonical transformations: 

(1.3) Lm = At*m, Lx — At*x- 



The manifolds Lm and Lx bear the natural measures pM and px given by 
the formulas 



(1.4) 



Mm 



A(n-f i/) 
M 



(n + v)\ 



) 






7t;(, 



, ,An\ 



n! 
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where ttj is the projection on the jth factor in the corresponding product of cotan- 
gent bundles. (These formulas are the standard formulas defining measures on 
graphs of canonical transformations [NOSS81]. By virtue of the Lagrangian prop- 
erty, the result is independent of the choice of j = 1, 2.) 

Coordinate description. The manifolds Lm and Lx are given in special coor- 
dinate systems on the cotangent bundles by the formulas 

Lm = {(x,t,p,T,x',p',t',T') jx=x',t = t',p=p',T = t'}, 

Lx = {(3:,p,x',p') 1 X = x', p = p'}. 

(From now on, the coordinates on the second factor in the product of cotangent 
bundles are indicated by primes.) The canonical coordinates (see Subsection A. 2) 
on Lm and Lx can be taken in the form (x,t,p\r') and (x,p'), respectively. Then 
the measures are given by the formulas 

pM = dp'i A dxi A ■ • • A dp'^ A dxn A dr[ A dti A ■ ■ ■ A drl A dtj^, 
px = dp'i A dxi A • • • A dp'^ A dXn, 

and the generating functions of these Lagrangian manifolds (see Subsection A. 2) 
have the form 



SM{x,t,p',T') =p'x + r't, Sx{x,p') =p'x. 



1.1.2. The manifold L^. 

Invariant description. This manifold can be obtained by applying the above- 
mentioned construction to the graph of the embedding i: 

(1.5) Lb = A* (graph i) C T*X x T*M. 

The manifold Lb (as well as all Lagrangian manifolds considered below) is not 
the graph of any canonical transformation, and so we cannot apply the standard 
construction (1.4) of the measure. To obtain a natural measure on Lb, consider 
the mappings 

(1.6) tti: Lb ^ T*X, 7 T 2 : T*M 

obtained by the restriction to Lb of the natural projections on the first and second 
factors, respectively, in the Cartesian product T*X x T*M. Let a E Lb he an 
arbitrary point. The differentials 

(1.7) TTi. : TaLb T^pa)T*X, 7T2. : T^Lb T^,ia)T*M 

possess the following properties: 

(1) TTi* is an epimorphism; 

(2) Tr 2 *|ker 7 ri* IS an isomorphism of the kernel kerTTi* onto the subspace in 

Ttx< 2 {cx)T*M parallel to the fiber of N*X at the point 7r(7Ti(a)) 

(where tt: T*X — > X is the natural projection). 
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After natural identifications, we obtain the exact sequence of vector spaces 

(1.8) 0 ^ ^ 0. 

There are natural volume forms on the fibers of TT*X (namely, the normalized 
power 

(1.9) rfvolT*X = A^x)^” 

n\ 

of the symplectic structure on X) as well as on the fibers of N'^X (namely, the 
form 

(1.10) dvoljv*x = A ... A 

where ti, . . . ,Tiy are the momentum variables dual to the coordinates 
from some special coordinate system (x, t); the form on the right-hand side in (1.10) 
is independent of the choice of coordinates). We define a volume form on 
by arbitrarily splitting the sequence (1.8) and by setting 

(1.11) /i5 = dvolT*x Ad voliv^x • 

(The result is independent of the splitting.) 

Thus, we have defined a mecisure jib on the manifold 

Coordinate description. The manifold is given in special coordinate systems 
on the cotangent bundles by the formulas 

(1.12) Lb = \ X = x', t' = 0 , p = p'}. 

The canonical coordinates on Lb can be taken conveniently in the form (a:,p',r'). 
Then the measure is given by the formula 

fjib = dp\ A dxi A • • • A dp'^ A dxn A dr[ A • • • A dr' , 
and the generating functions of Lb has the form 

Sb{x,p',T') =p'x. 



1.1.3. The manifold Lc- 

Invariant description. This manifold is defined as 

Le = 7V*(^graphz) C T*M x T*X, 

where the submanifold ^graphz C M x X is obtained as the transpose of graph A 
(The factors in the Cartesian product are transposed.) Clearly, Lc itself coincides 
with Lb up to transposition: 

(1.13) Lc = ^Lb C T*M X T*X. 

More formally, consider the transposition isomorphism 

x: T*X X T^M — > T*M x T*X, 

(a,/3) 1 — > iP,a); 



then 

(1.14) 



^{Tb) — Lc- 
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We use the isomorphism (1.14) and define a measure on Lc by setting 

(1.15) He = 

Coordinate description. The manifold Lc is given in special coordinate systems 
on the cotangent bundles by the formula 

(1.16) Lc = {{x,t,p,T,x',p') \ x = x',t = 0, p = p'}. 

The canonical coordinates on Lc can be taken in the form (a;,r,p'). Then the 
measure is given by the formula 

Pc = dp\ A dx\ A • • • A dp'^ A dxn A dri A • • • A 
and the generating function of has the form 

Sb{x,T,p') =p'x. 



1.1.4. The manifold Lg. 

Invariant description. This Lagrangian manifold is defined as 



(1.17) 


Lg = N*{W) C T*M X T*M, 


where 




(1.18) 


W = {(a, a)€MxM\aeX} 



Let 



(1.19) 7Ti,2 : Lg T*M\x C T*M 

be the mappings obtained by the restriction to Lg of the natural projections of 
T*M X T*M on the first and second factors. Consider the mapping 

(1.20) p: Lg — >T*X 
given by the composition p = n o m, where 

(1.21) n: T*M|x — >T*X 

is the natural projection. (Note that tt om = n o7T2.) Next, is an epimorphism 
at an arbitrary point a e Lg, and the mapping 

0 '^2*)\ker 

is an isomorphism of kerp^ onto the direct sum of two copies of the tangent space 
to a fiber of the conormal bundle of X. Thus, we obtain the exact sequence 

( 1 . 22 ) 0 ^ ^ ^ ^ 0 

for an arbitrary point a E Lg (where tt: T* — > X is the natural projection). This 
sequence permits one to define a measure pg on Lg by the formula 

(1.23) pg — dvolx^x Advoljv*x Advol^-x, 

where the factors on the right-hand side are given by formulas (1.9) and (1.10). 
(The two factors dvoljvx correspond to the two copies of in the ex- 

pansion (1.22).) 
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Coordinate description. The manifold Lg is given in special coordinate systems 
on the cotangent bundles by the formulas 

(1.24) Lg = {(x, r , ^ x = x' , t = t' = 0 ^ p = p'}. 

The canonical coordinates on Lg can be taken in the form {x,r,p' , t'). Then the 
measure is given by the formula 



Pg = dp[ A dxi A • • • A dp'^ A dxn A dri A * • • A dr^, A dr[ A • • * A dr' , 
and the generating functions of Lg has the form 

Sb{x,T,p',T') = p'x. 



Thus, we have defined the Lagrangian manifolds (1.2), constructed some nat- 
ural measures on these manifolds, and described canonical coordinates related 
to special coordinate systems in the cotangent bundles. (In the following, these 
canonical coordinates on Lagrangian manifolds will often be referred to as special 
canonical coordinates.) The following assertion holds. 

Proposition 1.1. The measures (im, l^x, l^b, l^c, o,nd pg are quantized. 

(Concerning the notion of quantized measures on Lagrangian manifolds, e.g., 
see [NOSS 81 ].) We omit the proof. 

Thus, Maslov’s canonical operator, which is used in the construction of Fourier 
integral operators (see the Appendix), is well-defined on all above-mentioned La- 
grangian manifolds with measure. 

We should possibly comment on the notation. The manifolds Lx and Lm 
are the graphs of identity canonical transformations. (The corresponding Fourier 
integral operators are just pseudodifferential operators.) The subscripts 6, c, and 
g on the manifolds L{,, L^, and Lc have been chosen in view of the fact that 
the corresponding Fourier integral operators are known as boundary operators, 
coboundary operators, and Green operators, respectively. 

1.2. Composition and transposition formulas. Now we shall study com- 
positions and transpositions of the Lagrangian manifolds introduced above. This 
proves useful, since the composition of Lagrangian manifolds corresponds to the 
composition of the corresponding Fourier integral operators and the transposition 
corresponds to the passage to the adjoint operator. The general definition of com- 
position for Lagrangian manifolds is given in the Appendix, Subsection A. 3. We 
have already noted that three of our Lagrangian manifolds, i.e., L^, L^ and Lg^ 
fail to satisfy the fundamental condition A.l: Each of these manifolds hais a non- 
empty intersection with the zero section of at least one of the cotangent bundles 
forming the product where this manifold lies. Hence the composition need not be 
proper in general (cf. Subsection A. 3), and we have to modify the definition. 
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1.2.1. Definition of the composition. 

Definition 1.2. Let 

(1.25) Li c T*Mi X T*M2, L2 C T*M2 x 

be two Lagrangian manifolds. Suppose that the following conditions hold. 

(1) The composition L = Li o L 2 given by (A. 2) is clean and connected (see 
Subsection A. 3). 

(2) The projection 

(1.26) p:L—^L, 
where 

L={LiX L 2 ) n (T*Mi X X T*Ms), 

is a locally trivial bundle over the manifold L. (The fiber of this bundle 
over a point (q!,/3) G L will be denoted by F(^a,f 3 )\ l^he dimension will 
be denoted by dimF(c^^^) = e and is referred to as the excess of the 
composition, just as in the general theory.) 

Then we say that the composition L = Li o L 2 is well-defined. (Note that L is 
automatically a Lagrangian manifold.) 

Needless to say, if the projection (1.26) is proper, then the local triviality of 
the bundle (1.26) follows from Thom’s theorem, and we return to the standard 
theory. 

1.2.2. The composition table. Now we are in a position to state the composi- 
tion theorem for Lagrangian manifolds. 

Theorem 1.3. Every meaningful composition of two Lagrangian manifolds 
from the list (1.2) is well-defined. The composition table has the following form 
{the first factor corresponds to a row and the second to a column): 





Lx 


Lm 


Lb 


Lc 


La 


Lx 


Lx 


— 


Lb 


— 


— 


Lm 


— 


Lm 




Lc 


La 


Lb 


— 


Lb 


— 


Lx 


Lb 


Lc 


Lc 


— 




— 


— 


L, 


— 


L, 


— 


Lc 


La 



Table 1.1 



Here dashes are placeholders for meaningless compositions. 

Next, the fiber of the projection (1.26) is a singleton (e = 0) for all compo- 
sitions except for the four compositions in the intersection of the last three rows 
and the last two columns. For each of these four compositions, the fiber of the 
projection (1.26) is naturally isomorphic to the fiber of the normal bundle N*X 
over the corresponding point of X {i.e., e = u in these cases). 
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Proof. The proof goes by a straightforward computation. 



□ 



Remark 1.4. We see that for the four compositions mentioned in the theorem 
(which will be referred to as exceptional), the fiber of the projection (1.26) is not 
compact. (It is isomorphic to M^.) Since the formula for the symbol of the product 
of Fourier integral operators (see Subsections 1.4 and 2.2) contains integration 
over the fiber, it is not at all surprising that order restrictions guaranteeing the 
convergence of the integral arise for such products. 

1.2.3. Transposition. The behavior of our Lagrangian manifolds and measures 
under transposition (see (A. 7)) is described by the following assertion, which can 
readily be verified by a straightforward computation. 

Proposition 1.5. One has 



^Lx = Lx, ^Lm = Lm, 



Lb — Tc, Lc — Lb 



- T 

^9 ~ -^ 9 ' 



Moreover, the transposition takes the above- defined measure on any of these La- 
grangian manifolds to the corresponding measure on the transpose {neglecting the 
sign). 



1.3. Symbols. Now we shall introduce symbol spaces on each of the La- 
grangian manifolds (1-2). These symbol spaces will be used in the quantization 
procedure (i.e., in the construction of the corresponding Fourier integral oper- 
ators). Just as in the standard theory of pseudodifferential operators (or Fourier 
integral operators) , there are various approaches to the definition of symbol spaces. 
On the one hand, one can define a symbol as an arbitrary function satisfying cer- 
tain estimates (which guarantee the continuity of the corresponding operator in 
appropriate Sobolev spaces). In this case, the notion of principal symbol (which 
alone is meaningful in classical mechanics) becomes rather complicated and incon- 
venient: One has to define the principal symbol as an element of a quotient space 
of the symbol space. On the other hand, one can single out a narrower space of 
classical symbols asymptotic for large values of the momentum variables to some 
-homogeneous function of these variables. It is the latter function that plays 
the role of the principal symbol. (Note that it usually does not lie in the origi- 
nal symbol space, since it has a singularity at zero. Thus, one has to use cut-off 
functions in the quantization procedure.) It is most convenient to combine the two 
approaches: One first introduces a wider symbol class and proves boundedness 
and composition theorems and then observes the invariance of the space of opera- 
tors with classical symbols with respect to composition and studies ellipticity, the 
Fredholm property, etc. in this narrower class. 

In this section, we introduce symbol spaces using the above-mentioned ap- 
proach. All main statements are given in special coordinates and special canonical 
coordinates on the Lagrangian manifolds, for we believe that coordinate state- 
ments are easier to comprehend than invariant statements in this case. We omit 
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the proof of independence of our definitions of the choice of special local coordi- 
nates. Needless to say, one can also give an invariant description of symbol spaces. 
By way of example, we give such a description for the manifolds and Lg. 

Finally, we note that the traditional approach to the definition of classical 
symbols requires that the symbols have asymptotic series expansions in homoge- 
neous functions at infinity. The operators to be constructed here act only in a 
limited interval of the Sobolev scale, and hence there is no need to require the 
existence of “long” expansions. Furthermore, we deal with qualitative issues of el- 
liptic theory, where lower-order terms play essentially no role. Therefore, we define 
classical symbols by imposing the minimal requirement of existence of only one 
(leading) term of the asymptotic expansion. 

Throughout the following, by x(^)? ^ we denote a smooth non- negative 

function such that 



(1.27) 



X{r) 



0, r- < 1/2, 

1, r > 1. 



1.3.1. Symbols on Lm cind Lx- These symbols are the symbols of pseudodif- 
ferential operators. We briefly recall the well-known spaces of such symbols so as 
to set the notation and clarify the scheme of the subsequent reasoning by a well- 
known example. To be definite, we consider the Lagrangian manifold Lx- The 
notation for Lm is entirely similar. 



Definition 1.6. By S^{Lx), where m G M, we denote the space of smooth 
functions a on the manifold Lx such that the following estimates hold in canonical 
coordinates: 



dx^dp'^ 






H + |/?| = 0,1,2,... . 



By 0^{Lx) we denote the space of functions a on the manifold Lx such that a is 
smooth outside the zero section (|p'| = 0) and -homogeneous of degree m (with 
respect to the standard action of the group R+ in the fibers). 

By S^{Lx) C S'^(Lx) we denote the subspace of functions representable in 
the form 



(1.28) a = x{\p'\)do + ^5 O'O ^ 0'^{Lx), b e ^{Lx) for some 5 > 0. 

Elements of the spaces S'^(Lx), S'^{Lx), and 0^{Lx) are called, respectively, 
symbols, classical symbols, and homogeneous (principal) symbols of order m on 
Lx- The element ao G O^(Lx) corresponding to a symbol a G S'^(Lx) according 
to (1.28) is called the (homogeneous) principal part of a. 

One can readily see that the homogeneous principal part of a symbol is 
uniquely determined. 

The definitions of homogeneous principal symbols for the other Lagrangian 
manifolds look somewhat more complicated, since these symbols have singularities 
not only on the zero section. 
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1.3.2. Symbols on and Lc- First, we introduce symbol spaces on the mani- 
fold Lb, The symbol spaces on Lc are obtained from these via the mapping 
where x is the isomorphism (1.14). 

Let k and I be given real numbers. 

Definition 1.7. By Sj^'^(Lb) we denote the space of smooth functions a on 
the manifold Lb such that the following estimates hold in canonical coordinates: 



(1.29) 



, r') 

dx^dp'^dr'^ 



1^1 + \P\ + ItI = 0, 1, 2, . . . 



By 0^"\Lb) we denote the space of functions a on the manifold Lb with the 
following properties: 

(1) a is defined and infinitely smooth outside the set 

F = {p' - 0} C Lb\ 

(2) a is M-|_-homogeneous of degree k 1 in the variables (p',r^): 

a{x, Xp' ^ Xr') = X^^^a{x,p\r'), A G / 0; 

(3) for p' ^ 0, the function a satisfies the estimates 



g<^+P+ia{x,p',r') 

dx^dp'^dr'"^ 






+ \P\ + I 7 I — 0, 1, 2, . 



By S^'^^(Lb) C Sj^'\Lb) we denote the subspace of functions representable in 
the form 






(1.30) a = x{\p'\)(^o + ^ ao G O^^^(Lb), 

b G Sl~^'\Lb) 0 Sj^’^~^{Lb) for some c > 0. 

Elements of the spaces S^"\Lb)^ S^'^^(Lb), and 0^"\Lb) are called, respectively, 
symbols, classical symbols, and homogeneous (principal) symbols of type (k,l) on 
Lb. The element oq G 0^'\Lb) corresponding to a symbol a G S^'l^(Lb) according 
to (1.30) is called the (homogeneous) principal part of a. The number r k-\- 1 -\- 
v/2 is called the order of a (or uq) and is denoted by 

orda = orduo = k 1 v j2. 

This is well-defined, as shown by the following almost obvious proposition. 
(The proof is by straightforward computation and is therefore omitted.) 

Proposition 1.8. Lei a g O^'^(Lb). Then x(|p'l)« ^ U Xi('^) 

another smooth function with property (1.27), then 

(x(|p'l)-Xi(b'l))a€Syi''(L,). 
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It follows from the definition of the spaces O^'^(Lb) and S^’^^(Lb) that for 
a given a G the function ao in (1.30) is determined uniquely and is 

independent of the choice of the cut-off function y. 

Invariant description. Let us show how one can rewrite the estimates (1.29) 
in invariant form. To this end, we note that Lb is a vector bundle; we define a 
function |a|, a € Lb, as a norm in the fibers smoothly depending on the point 
of the base. In a similar way, we introduce a norm in the fibers of T*X (the one 
induced by the Riemannian metric on X). 

We consider two kinds of vector fields on Lb (see (1.7) for the properties of tti*): 

• vector fields annihilated by where tti is the projection on the first 
factor in the product T*X xT*M; such fields will be referred to as normal 
to 

• vector fields mapped by 7 Ti=^ to well-defined vector fields on T^X (thus, 
for each P e T*X the application of tti* to the vector field at a point 
a G '7Tj“^(/ 9) gives a result independent of the choice of a); such fields will 
be referred to as lifted from T*X. 

Now we can restate the first part of Definition 1.7 as follows. 

Definition 1.9. By S^'\Lb), where k,l eR, we denote the space of smooth 
functions a on the manifold Lb such that the following condition holds: Suppose 
that {Vi, . . . , Lj} is an arbitrary (possibly, empty) finite set of smooth vector fields 
on Lb such that each of the fields is homogeneous of degree 0 or 1 and is either 
normal to T*X or lifted from T*X] then 

(1.31) 1^1 • Vja{a)\ < C{\ + 

where ji is the number of first-degree homogeneous fields normal to T*X and 
is the number of first-degree homogeneous fields lifted from T*X. (The constant 
C in (1.31) depends on the choice of the fields Vi, . . . , V^.) 

Symbols on Lc^ We define symbol spaces on Lc as follows. 

Definition 1.10. The spaces 

(1.32) = (x-')*S^“(Lf,), 

= (x-i)*0^'"(Li), (L,) = 

where x is the diffeomorphism (1.14), are called, respectively, the spaces of symbols, 
classical symbols, and homogeneous (principal) symbols of type (m, k) on Lc- The 
element ao G O^’^(Lc) corresponding to a symbol a G S^^!^(Lc) according to the 
formula 

a = x(b'l)ao +b, b£ 5^“"’*^(Lc) © for some e > 0, 

is called the {homogeneous) principal part of a. The number r := m + k + vj2 is 
called the order of a (or uq) and is denoted by orda. 




RELATIVE ELLIPTIC THEORY 



515 



Remark 1.11. The “correction” vj2 in the definition of the order of symbols 
on L\y and ensures that the order of a symbol is equal to the order in the Sobolev 
scale of the operator obtained by the quantization of the symbol. The correction 
V in the definition of the order of symbols on Lg has the same meaning. 

1.3.3. Symbols on Lg. Let m, k, and I be given real numbers. 

Definition 1.12. By we denote the space of smooth functions a on 

the manifold Lg such that the following estimates hold in canonical coordinates: 



(1.33) 



^a+/3+7+(5^^^^ p', r, t ') 
dx^dp'^dr'^dr'^ 






X (1 + \p'\ + |a| + \p\ + | 7 | + 1-51 = 0, 1, 2, • . . 



By we denote the space of functions a on the manifold Lg with the 

following properties: 

(1) a is defined and infinitely smooth outside the set 

r - {/ = 0} C L,; 

(2) a is M+-homogeneous of degree m-\- k + I in the variables (p', r, r'): 

a{x, Xp' , Xr^ Xr') = A C 7^ 0; 

(3) For p / 0, the function a satisfies the estimates 



dx°^dp'^dr'^dr'^ 



< Cap.ys\pf-^^K\p'\ + 

\^\ + \P\ + I 7 I + |(^| = 0 , 1, 2, . . . 



By S^j^'\Lg) C we denote the subspace of functions representable 

in the form 



(1.34) a = x{\p'\)ao + b, a^eO^^^\Lg), 

b G S^-^'^\Lg) © S^^^-^\Lg) © S^^^^^-%Lg) for some £ > 0. 

Elements of the spaces S^'^'\Lg), S'^'^'\Lg), and O^^^'^(Lg) are called, respec- 
tively, symbols, classical symbols, and homogeneous {principal) symbols of type 
{m,k,l) on Lg. The element uq G corresponding to a symbol a G 

S^^^'^Lg) according to (1.34) is called the {homogeneous) principal part of the 
symbol a. The number r :=m + A; + / + pis called the order of a (or ao) and is 
denoted by 

ord a = ord uq = m + A; + ^ + i/. 

Just as in the other cases, one can verify that the principal part of a symbol 
is well-defined and unique. 
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Invariant description. Let us show how one can rewrite the estimates (1.33) in 
invariant form. To this end, we consider the following three kinds of vector fields 
on Lg (see (1.22)): 

• vector fields everywhere tangent to the first copy of N*X (they will be 
referred to as normal fields of the first kind)] 

• vector fields everywhere tangent to the second copy of N*X (they will 
be referred to as normal fields of the second kind); 

• vector fields lifted from T*X. 

Now we can restate the first part of Definition 1.12 a-s follows. 

Definition 1.13. By where m^kj G M, we denote the space of 

smooth functions a on the manifold Lg with the following property: If {Vi, . . . , V^} 
is an arbitrary (possibly, empty) finite set of vector fields on Lg such that each 
of the fields is homogeneous of degree 0 or 1 and either is normal of the first or 
second kind or is lifted from T*X, then the estimate 

(1.35) \Vi ■■■Vja{a)\ < C(1 + |7ri(a)|)'"“-^‘ (1 + |p(a)y'^^^(l + |7T2(a)|)''‘^^ 

holds, where j\ is the number of first-order homogeneous normal fields of the first 
kind, is the number of first-order homogeneous normal fields of the second kind, 
j 2 is the number of first-order homogeneous normal fields lifted from T*X, tti and 
7T2 are the projections on the first and second factors, respectively, in the Cartesian 
product T*M xT*M, and p is the projection (1.20). 

Thus, we have defined quite a number of symbol spaces. To simplify the no- 
tation, in the following we usually omit the manifold argument in the notation of 
symbol spaces, i.e., write, say, instead of aS'J^’^’^(L^), etc., provided this does 

not lead to confusion. 

1.4. The product of symbols (twisted multiplication). Let L\ and L2 

be two Lagrangian manifolds (1.25) such that the composition L = Li o L 2 is 
well-defined. Then there is an operation, called the twisted multiplication in what 
follows, that takes pairs of symbols on Li and L 2 to symbols on L. (See the 
Appendix, Subsection A. 7.) This operation involves integration over the fibers of 
the bundle (1.26). In our situation, the fibers need not be compact, and so the 
twisted product is defined only under certain restrictions on the types of factors. 
First, let us write out an expression for the twisted product specifying the general 
assertion in the Appendix. 

1.4.1. The general twisted product formula. Let the manifold Li, L 2 , and L 
be equipped with smooth real measures pi, p 2 ^ and p, respectively. We make 
some choice of the half-densities ^ypl, ^/P 2 , y/p> For example, we can adopt the 
convention that y/p is represented in local coordinates on L by the arithmetic 

square root \/iH> where p is the density of p in these coordinates. Then the 
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twisted multiplication 

*: Co~(Li) X C^(L2) ^ CS^(L), 

(1-36) (/l,/ 2 ) /l * /2 

can be described £ls follows. The expression 

(/i v/Mi ) (a, /?) (/2 ^/M2) (^, 7) > 

(a,/3) G Li c T*(Mi X M 2 ), (/3,7) 6 -f ^2 C T*(M 2 x M 3 ), 

is a half-density on L whose values are densities on the fibers i^(a, 7 ) of fho bun- 
dle (1.26). Hence the expression 

(1.37) (/i*/ 2 )(a, 7 ) = T(^^j ^ (fiv^)(a,p)(f2Vf^)(/3,7) 

is a well-defined function on L (cf. [H6r85b, Theorem 25.2.3]). In local coordi- 
nates, this function is represented by an ordinary integral over the fiber variables. 
The normalizing factor (1/27 t)^ is introduced so as to ensure that there is no 
additional factor in the formulas for products of operators. 

If the fiber T'(a, 7 ) is compact, then the twisted product (1.37) is defined not 
only for compactly supported, but also for arbitrary smooth functions. In the 
general case, we say that the twisted product (1.37) is defined for given functions 
fi G C^{Li) and /2 G 0^{L2) if the integral on the right-hand side in (1.37) is 
absolutely convergent 

1.4.2. A twisted product theorem. We now describe the twisted products (1.36) 
in the symbol spaces introduced above for the cases corresponding to the compo- 
sitions of Lagrangian manifolds described in Theorem 1.3 (see Table 1.1). 

First, we consider the case of “trivial” products, where at least one of the 
factors is the diagonal manifold Lm or Lx - By Theorem 1.3, the fiber of the bun- 
dle (1.26) is a singleton so that the twisted products are always defined. The type 
of the product can readily be expressed via the types of the factors. Leaving aside 
the case in which both factors are diagonal (and hence one deals with products of 
pseudodifferential operators), we state the following theorem. 

Theorem 1.14. The twisted product is well-defined in the following symbol 
spaces for any values of the indices: 

(1.38) 5””(Lx) * 5*’' c 5”+''’', 

(1.39) 5™(Lm) * C S""(Lm) * 5^'’''’' C 5™+’"'’''-', 

(1.40) S^’‘ * S"^(Lm) C 5^+"*, * S^{Lm) C 5™'’'=’'+“, 

(1.41) * S^{Lx) C 5^’'^+"*. 

For any of these compositions, one has 

(1.42) ord(ai * 02 ) = ordai + orda 2 - 
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The following theorem describes the twisted products (1.36) corresponding to 
the compositions in Table 1.1 for the case in which neither of the factors is Lx or 
Lm- 



Theorem 1.15. The twisted product of symbols corresponding to the compo- 
sitions of Lagrangian manifolds in the last three rows and columns of Table 1.1 
described by the following table: 





C^2,^2 


^7712,^2 


^77l2,/C2,^2 


Qki ,li 


— 


Qki-\-li-\-k2+m2+i' 


+ f 1 +A:2+7772 + ^',^2 




^mi ,ki+k2,l2 


— 


— 


^mi ,/ci ,/i 


— 


^mi ,/ei+L+fc2 +7712+1^ 


^777 1 ,A:i + +A;2 “I“7T72 



Table 1.2 



The twisted product 

is defined for arbitrary values of the indices. The remaining four products in Ta- 
ble 1.2 are defined under the condition 

(1.43) 

Finally, condition (1.42) holds for each of these products. 

Let us now state the assertion concerning the twisted product of homogeneous 
principal symbols. 

Theorem 1.16. Let ai and U 2 be classical symbols whose twisted product a = 
Ui*a 2 is well-defined by one of the two preceding theorems. Next, letaio, 020 , andao 
be the homogeneous principal symbols corresponding to ai, 02 , and a, respectively. 
Then the twisted product aio * a 2 o is well-defined and aio * a 2 o = 



Coordinate description. Let us give the expressions for a = ai * U 2 in spe- 
cial coordinate systems for the cases shown in Table 1.2. (The cases described in 
Theorem 1.14 are left to the reader.) They have the following form: 



Lh o Lq: 

Lq o Z/5 . 



^9 ° ^9 • 



L9 O Lq 



L\) o Lq 



/ 1 V /* 

a{x,p')= ( — 1 / ai{x,p',T)a2(x,p',T)dT; 

a{x,T,p',T') = ai{x,T,p')a2{x,p',T')\ 

/ 1 V /■ 

a{x,T,p',T') = ( ^ ) / ai{x,T,p',T'')a2{x,T'',p',T')dT''; 

a{x,T,p') = f — 1 / ai{x,T,p' ,T')a2{x,T' ,p') dr' ; 

a(x,p',r')= (T) f ai{x,p',T'')a2{x,T”,p',T')dT". 

\Z7T/ J 
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2. Quantization and the algebra of operator morphisms 

Now we proceed to the second stage in the construction of our operator algebra. 
Namely, we quantize the classical objects introduced in the previous section. The 
elements of the algebra are 2x2 matrices with operator entries. First, we describe 
these entries, which will be referred to as the main operators^ and then we deal 
with the matrices. 

2.1. The main operators. We have constructed five Lagrangian manifolds 
with measures in Subsection 1.1 and the corresponding symbol classes in Subsec- 
tion 1.3. We obtain five types of operators by quantizing these objects, i.e., by 
considering the corresponding Fourier integral operators. 

2.1.1. Pseudodifferential operators. The quantization of symbols on Lm and 
Lx results in pseudodifferential operators on M and X, respectively. This proce- 
dure is well-known, and we only mention that pseudodifferential operators them- 
selves will be denoted by upper-case letters (for example, Dm or Dx) and their 
symbols (or principal symbols, depending on the context) by the corresponding 
lower-case letters: 

(^{Dm) = dMi o-(Dx) — dx^ 



2.1.2. Boundary operators. 

Definition 2.1. The boundary operator with symbol a G S^'\Lb) is the 
Fourier integral operators ^^[a] on the Lagrangian manifold with measure pb 
and symbol a. 

The boundary operator with principal symbol oq G 0^'\Lb) is the operator 
?6[«o] "= with symbol a = x(b'l)«o- 

Remark 2.2. Owing to the ambiguity in the construction of the canonical 
operator, the operator ^b[o] is determined only modulo operators whose symbols 
are of lower order than a. (The same remark pertains to all other operators that 
will be constructed in what follows.) 

Example 2.3. By taking a = 1, we obtain the elementary boundary operator 

(2.1) z*: C^{M) -^C^(X), 

which takes each function / G C^{M) to the restriction i* f E C^{X) of / to X. 

Theorem 2.4. Let a G S^'\Lb). Then the operator ^6 [a] is continuous in the 
spaces 

(2.2) ^b[a ] : H^{M) F^“^(X), r = orda, 

for s > / + p/2. 
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Coordinate description. Let us write out the expression for in special 

coordinates (x,t). The operator ^6 [a] is given by the formula 



(2.3) 






where u{p',r') is the Fourier transform of u{x',t'). 



2.1.3. Coboundary operators. 

Definition 2.5. The coboundary operator with symbol a G S'^'^(Lc) is the 
Fourier integral operator on the Lagrangian manifold Lc with measure pc 

and symbol a. 

The coboundary operator with principal symbol uq G 0^^^{Lc) is the operator 
$cK] "= with symbol a = x(b'l)<^o- 



Example 2.6. By taking a = 1, we obtain the elementary coboundary operator 

(2.4) U: P'(X) — ^D'(M), 

which is the L^-adjoint of the elementary boundary operator. It can be locally 
described in the special coordinates {x,t) as follows: 

(2.5) [ug]{x, t) = g{x) (g) 6{t), 

where 6 is the Dirac delta function. In other words, i^g \s the product of g by 
the delta function in the transversal directions, or the delta function on X with 
density g so that one sometimes writes i^g — gSx- 

Theorem 2.7. Let a G S^'^{Lc). Then the operator 4>c[a] is continuous in 
the spaces 

$,[a]: H^{X) ^ r = orda, 

for s < k. 



Remark 2.8. The operator ^c[o] is actually continuous in the spaces 
$e[a]: W{X) ^ 

for s > k. (Here e > 0 is arbitrary.) This follows from the embedding H^{X) C 
H^~^{X) in conjunction with Theorem 2.7. However, we do not consider these 
values of s, since the order of the operator is not related to the order of the 
symbol for these s and composition theorems considered in the next subsection 
are no longer valid owing to the fact that one cannot neglect lower-order terms in 
asymptotic expansions of Fourier integrals. 
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Coordinate description. By analogy with the preceding, we can write out the 
expression for the coboundary operator in special local coordinates. It has the form 

n-\-u 

(2.6) ($c[a]M)(a;,t) = 



r f 

/ r,p')il(p')dp'dr. 



2.1.4. Green operators. 

Definition 2.9. The Green operator with symbol a G is the 

Fourier integral operator ^g[a] on the Lagrangian manifold Lg with measure fig 
and symbol a. 

The Green operator with principal symbol oq G 0^^^^\Lg) is the operator 
^g[^] with symbol a = xdp'D^^o- 

The following boundedness theorem is valid for Green operators. 

Theorem 2.10. Let a G be a Green symbol. Then the operator 

^g[a] is continuous in the spaces 

^g[a\: H^{M) r = orda, 

for 1//2 + / < 5 < I//2 + / 4- /c. 

Remark 2.11. It follows from Theorem 2.10 that it makes sense to consider 
Green symbols only for /c > 0, since otherwise the set of values of s for which the 
Green operator is continuous in the above-mentioned spaces is empty. 



Coordinate description. The expression for a Green operator in special coor- 
dinates has the form 

(2.7) ($g[a]M)(a;,t)= ^ r,p', t')m(x', f') 



2.1.5. An interpretation of the main operators as pseudodifferential operators 
with operator- valued symbols. In conclusion, we note that, modulo operators with 
smooth kernel, boundary, coboundary, and Green operators are concentrated on 
the submanifold X. This follows from the form of the corresponding Lagrangian 
manifolds. Hence the structure of these operators in a neighborhood of X is of main 
interest. It turns out that in a tubular neighborhood of X these operators can be 
interpreted as pseudodifferential operators on X with operator-valued symbols 
acting in function spaces on the fibers of the normal bundle of X. (Recall that a 
neighborhood of the zero section of the normal bundle is identified via the geodesic 
exponential map with a tubular neighborhood of X.) 
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By way of example, let us show this for the case of Green operators. 

Indeed, formula (2.7), specifying the operator $g[a] in special coordinates, can 
be rewritten in the form 



$g[a]u{x,t) 



or 

( 2 . 8 ) 



I 

2tt 



\ V2 -u/2 

,ipx 



/■ 



(27t)3‘^/2 






d \ 

^g[a]u{x, t) — H[x, ju{x, t)^ 



where H{x,p) is the operator- valued symbol acting on functions of the variables t 
by the formula 

(2.9) H{x,p)v{t) = j e^*'^a{x,p,T,T')^T')dT'dT. 

Actually, the operator H{x,p) is a Green operator with parameters {x,p) acting 
in a space of functions of t. The symbol of this operator is a{x,p,T,r') (where x 
and p are treated as parameters). The passage 

(2.10) a{x,p,T,T') H{x,p) $g[a] 

can naturally be interpreted as a two-stage quantization procedure, first along the 
fibers of the normal bundle of X (which gives an operator- valued symbol over X) 
and then along X. 



2.2. Composition formulas and adjoint operators. 

Composition. Here we state the composition theorem for the main operators, 
viz. pseudodifferential operators on M and X, (co)boundary operators, and Green 
operators. To unify the statement, we temporarily denote the Fourier integral 
operator with symbol a on a Lagrangian manifold L from the list (1.2) by ^(L, a). 
(The choice of a measure on L has been described above.) 

Theorem 2.12. Let L\ and L2 be two manifolds from the list (1.2) such that 
the composition Li o L2 is well-defined and let ^(Li,ai) and ^(L2,tt2) be Fourier 
integral operators with symbols in some of the classes introduced above such that 
the composition 

^(Li, ai)^(I/2, tt2) 

is well-defined as a product of bounded operators in accordance with the bounded- 
ness theorems. Then the twisted product 02 is well-defined, and the composition 
formula 

^(Li, ai)^(L2, tt2) = ^{Li o L2, ai ^02) 

is valid modulo operators of order < ordai -f- orda2- 

The same assertion remains valid if ai and 02 are the homogeneous principal 
symbols of the corresponding operators. 
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The adjoint operator. 

Theorem 2.13. Let L he a manifold from the list (1.2) and let ^(L,a) be a 
Fourier integral operator with symbol from some of the classes introduced above 
such that the operator ^(L,a) is well-defined as a hounded operator by the bound- 
edness theorems. Then the formally -adjoint operator is given by the formula 

(2.11) ($(L,a))*=$(T,(^^) 

modulo operators of order < ordai + orda 2 . Here the bar over the symbol on the 
right-hand side stands for complex conjugation and 

If: L -^'^L 

is the mapping obtained by the restriction to L of the transposition of factors in 
the Cartesian product of cotangent bundles. 

The same assertion remains valid if by a we mean the homogeneous principal 
symbol of the Fourier integral operator. 

2.3. Algebras of operator morphisms. Now we are in a position to con- 
struct the operator algebras. They will consist of 2 x 2 operator matrices of the 
form 

/Dm + 

\ $6 Dx)' 

Since the formal “multiplication” of the corresponding matrices of Lagrangian 
manifolds gives 

I Lm T Lg Lc\ I Lm T Lg Lc\ ( Lm F Lg Lc\ 

V Lt Lx)[ L, Lx)~[ L, Lxj’ 

one can hope that the set of operator matrices of this form is indeed closed with 
respect to composition. 

Let us proceed to exact statements. 



2.3.1. Definition of the algebras. Since the range of the Sobolev smoothness 
exponent s for which Green, boundary, and coboundary operators are defined is 
not the entire real line, we see that operators of positive order with such entries 
will not form an algebra. However, for any s and a one can indicate such symbol 
spaces for all entries for which the operators 

$6 Dx) H‘^{X) H'^iX) 

will be continuous and form an algebra. We present the corresponding result for 
s = (T = 0. The general case was analyzed in [SS96]. 

Let nig, kg,kc,k), £Whe given numbers satisfying the inequalities 

kg > 0 , kc> 0 , kb > 0 , 



( 2 . 12 ) 



mg < 



V 

2 ’ 



T hg 



> 



V 

2 ' 



(2.13) 
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(Note that system (2.13) is consistent. For example, one can take rrig = —u, kg = i/, 
kc = kb = 1 as Si solution.) 

We set 

(2.14) Ig = —Trig — kg — rric = —kc — z^/2, lb = —kb — z^/2. 

The following assertion is a straightforward consequence of the boundedness 
and composition theorems. 

Theorem 2.14. The set A{mg,kg,kc^kb) of operator 2x2 matrices of the 
form 

(2 X5) ^gi^g] 

^ ^ V $6K] Dx ) ’ 

where Dm ond Dx ore zero- order pseudodifferential operators on M and X, re- 
spectively, and the symbols Og, Oc, and Ob lie in the spaces 

is a linear space of continuous operators in Lf‘{M) 0 L‘^{X). 

The {non- direct) sum 

A= A{mg,kg,kc,kb) 

mg,kg,kc,kb 

over all mg, kg, k^ kb satisfying (2.13) is an algebra. 

Remark 2.15. From the practical viewpoint, it is of interest to consider oper- 
ators of non- zero order in Sobolev spaces other than \ theoretically, it suffices to 
study the algebras described in Theorem 2.14, since an operator of the form (2.15) 
acting from (M) 0 H^‘^{X) into (M) 0 H^‘^{X) can always be reduced to 
an operator in the space L‘^{M) 0 L‘^{X): One simply multiplies it on the right 
and on the left by appropriate diagonal matrices of pseudodifferential operators. 

Remark 2.16. Let mg, kg he given numbers satisfying the inequalities 

(2.16) mg < -Z//2 < rup 0 kg. 

We set 

(2.17) kb — mg kg vj2 kc — —mg — i//2. 

Then inequalities (2.13) are satisfied automatically. We write 

(2.18) A{mg,kg) = A{mg, kg,kc, kb), 

where kb and kc are given by formulas (2.17). 

A careful computation of the exponents according to Table 1.2 in the compo- 
sition theorem 1.15 shows that A{mg,kg) C A is a subalgebra. 

In what follows we mainly deal with subalgebras of the algebras defined above 
formed by classical operators (i.e., operators with classical symbols). 
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2.3.2. Involution. Theorem 2.13 implies the following assertion. 

Theorem 2.17. The algebra A is an involutive algebra with involution taking 
each operator to its L‘^ -adjoint. Moreover, 

(2.19) A{mg,kg,k,,ki,y =A{mlXg.KX)^ 
where 

(2.20) m*^-mg-kg-u, k* = kg, kX h, kl = kc. 

In particular, the subalgebras 

(2.21) A{-{k + u)/2,k) cA 

are invariant with respect to involution. 



2.3.3. Green subalgebras. There is an important subalgebra of A formed by 
matrices of the form 



% 

0 o; ■ 



This subalgebra is naturally isomorphic to the algebra of operators of the form 
^g in L‘^{M). (As follows from the composition theorem, such operators indeed 
form an algebra.) More precisely, let us give the following definition. Let numbers 
m,k,l G R satisfy the relations 

/9 99X j m + k-hl + jy = 0, 

^ ^ X / + p/2 < 0 < / + p/2 + /c. 

We set = O^^^'XLg). (Note that the notation is adequate, since 

(2.23) k = k{m, 1) = —m — I — v 



is uniquely determined by m and /.) 



Definition 2.18. The Green algebra is the set of continuous linear 

operators in lP‘{M) representable in the form 

(2.24) A-$^[a] + A, 

where a G and iG is a compact operator in L‘^{M) {K G JC). Elements of 

the Green algebra are called Green operators. 



Green algebras play an important role in the ellipticity conditions (see the 
next section). 



3. Elliptic morphisms and the index formula 

In this section, we give the definition of ellipticity for morphisms, prove theo- 
rems concerning the Fredholm property, and present an index formula for elliptic 
morphisms that do not contain Green operators. In the ellipticity conditions for 
general morphisms, the almost inversion of operators of the form 1 + T, where 
T = ^g[a] is a Green operator, plays an important role. We start our exposition 
with a study of such operators. 
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3.1. The Green equation. 

3.1.1. Statement of the problem. Consider the equation 

(3.1) u + ^g[a]u = f e L^M) 

for an unknown function u € L^(M), where a € is a given principal symbol. 

In more detailed notation, Eq. (3.1) has the form 

(3.2) u{x,t) J K{x,t,x' ,t')u{x' ,t')dx'dt' = f{x,t), 
where the kernel K{x,t,x' ,t') is given by the formula 

(3.3) K{x,t,x',t') = e^^P^---'^+^*-^'*'\xa){x,p,T,T')dpdTdr'. 

Equation (3.1) (or (3.2)) will be called the Green equation of the second kind, 
or simply the Green equation. As is often the case in the theory of integral equa- 
tions, one cannot solve Eq. (3.1) exactly or even write out informative conditions 
guaranteeing the unique solvability (except for the trivial case in which the norm 
of the operator ^g[a] is less than one). Thus, we proceed to the analysis of condi- 
tions under which Eq. (3.1) is Fredholm. Here one can already obtain non-trivial 
results, namely, a criterion for the Fredholm property of Eq. (3.1) in terms of the 
principal symbol a. This criterion is described in the subsequent items. 

3.1.2. An equation for the symbol of an almost inverse. It is well-known that 

an equation is Fredholm if and only if the operator specifying the equation has a 
(two-sided) almost inverse. Let us seek a right-almost inverse of 1 -h in the 
form 1 + where b G Then we have 

(3.4) (1 + $^[a])(l -h 4>g[6]) = 1 -h ^g\a + 6 -h u * 6] 
modulo compact operators, and for the symbol b we obtain the equation 

(3.5) b + a^b = —a 

Likewise, if we seek a left-almost inverse in the form 1 + ^g[c], then for c we 
obtain the equation 

(3.6) c + c * a = —a. 

3.1.3. Ellipticity and the Fredholm property for the Green equation. Here we 
state necessary and sufficient conditions for the Fredholm property of Eq. (3.1). 
The remaining items deal with the proof of the theorem stated in this item. 

Definition 3.1. We say that the Green equation (3.1) (and the operator 
1 -h ^g[o]) is elliptic if the equation 

(3.7) w a^w = V 

has a solution w G for every right-hand side v G 
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Remark 3.2. The solvability of Eq. (3.7) with arbitrary right-hand side is 
equivalent to the solvability of Eq. (3.5) (i.e., Eq. (3.7) with special right-hand 
side —a). Indeed, one of the implications is trivial; as to the other, if 6 is a solution 
of (3.5), then the solution of (3.7) for arbitrary v is given by the formula 

(3.8) w = b a V b ^ {a v), 

which can readily be verified by a straightforward substitution into the equation. 
Theorem 3.3. The Green equation (3.1) is Fredholm if and only if it is elliptic. 

Corollary 3.4. The operator 1 + ^g[o] G is Fredholm if and only if 

it has an almost inverse {a regularizer) in the algebra . 

Indeed, the symbol of the regularizer is just given by the solution of Eq. (3.5). 

Remark 3.5. Note that the ellipticity condition does not involve Eq. (3.6) or 
the unique solvability of Eq. (3.5). We shall see from the proof that the solvability 
of Eq. (3.5) is equivalent to the solvability of Eq. (3.6) and is equivalent to the 
unique solvability of either one of these equations. 

Proof. The proof splits into several steps described in the forthcoming items. 
Let us rewrite Eq. (3.7) in coordinates: 

(3.9) w{x,p,t,t') + a{x,p,T,T'')w{x,p,T",T')dT'' = v{x,p,t,t'). 

It is natural to treat this equation as a family of equations depending on the 
parameters (x,p, r'). Let us study the properties of this equation. First, without 
loss of generality we can assume that m = 1. Indeed, we set m = (m + /)/2 and 
X = (m — Z)/4. The map 

(3.10) a{x,p,T,T') I — » (p^ + P)“^a(a;,p,T,T')(p^ +r'^)^ 

is an isomorphism of onto the form of Eq. (3.9) remains unchanged 

if we apply the transformation (3.10) to all functions w, a, v occurring in the equa- 
tion. Thus, from now on we assume that m = 1. Then it follows from the restrictions 
imposed on m, /, and k that 

m < — 1//2. 

Since 

|a(x,p,r,r')| < C|p|'=(|p| + |r|)-(H + |r'|)-, 
we see that the kernel in (3.9) is square integrable with respect to the variables 
r, r" so that for any given (x,p, r'), p ^ 0, this equation is a Fredholm integral 
equation of the second kind in the space L^(M^). It follows from Fredholm theory 
that this equation is solvable in L^(M^) for any right-hand side if and only if 
the homogeneous equation has no non-zero solutions in L^(R^). However, we are 
interested in solutions of this equation in First, consider the case in which 

the homogeneous equations (3.9) have no non-zero solutions in L^(R^) for any 

(x,p), p^O. 
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Proposition 3.6. In the absence of non-zero solutions of the homogeneous 
equation, the solution in of Eq. (3.9) with right-hand side in lies 

in 



Proof. The desired -homogeneity of the solution follows from the M+- 
homogeneity of the kernel and the right-hand side in conjunction with the unique- 
ness of the solution. Next, the function w is obtained from v by an application of 
the continuous inverse in L^(R^) to the Fredholm operator of the second kind in 
Eq. (3.9) so that the differentiability of w (viewed as a function ranging in L^) 
with respect to variables {r,x,p) is obvious. Now it is easy to prove the desired 
estimates for w and the derivatives of w by induction over the order of the deriv- 
ative, using the relation obtained from (3.9) by the transposition of the integral 
term to the right-hand side, which completes the proof. □ 

Note that Eq. (3.6) is the complex conjugate of the adjoint equation of (3.5), 
and it follows from Fredholm theory that both equations are solvable or unsolvable 
simultaneously. 

The case in which the homogeneous Fredholm equation has a non-trivial so- 
lution is consider in the next item. 

3.1.4. The operator 1 -h ^^[a] is not Fredholm if Eq. (3.9) is not uniquely 
solvable. 

Proposition 3.7. Suppose that the homogeneous equation 

(3.11) ^ = 0 

has a solution p G L^(R^) for some values {x,p) = (xq,pq) G x (R^ \ {0}). 
Then the operator 1 + [a] is not Fredholm. 

Proof. Without loss of generality, we can assume that |po| = 1- We shall 
construct a family of functions u\ G L‘^{M), A G R+, with the following properties: 

(a) \\ux\\ = 1 for all A; 

(b) 11(1 -h $^[a])uA|| 0 as A ^ oo; 

(c) u\ weakly converges to 0 as A ^ oo. 

The existence of such a sequence implies that 1 -h ^g[a] is not Fredholm. Indeed, 
we argue by contradiction: Let 1 + [n] be Fredholm and let be a regularizer 

so that 

R{l-I^g[a]) = ll-K, K eJC. 

Then 

(3.12) ux = R{1 -h ig[a])7/A - Kux 0 

as A ^ cx) by (b),(c), and the fact that a compact operator takes each weakly con- 
vergent sequence to a strongly convergent sequence. But Eq. (3.12) contradicts (a). 
We set 

(3.13) 



Ux{x,t) = - xo))(fi{\t), 
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where c\ is a constant normalizing u\ in u{x) is a smooth compactly supported 
function, and (f{t) is the inverse Fourier transform of The function (3.13) 

satisfies condition (a) by construction. Next, one can readily see that this function 
weakly converges to zero as A oc (i.e., condition (c) holds): It suffices to show 
that 

J ux{x,t)(fi{x)(p2{t)dxdt^0 

as A ^ CO for any smooth compactly supported functions (pi and (p 2 , but this 
can readily be proved by integration by parts with respect to x with regard to 
the fact that c\ ~ \nl 2 +u^ remains to verify condition (b). Using the repre- 
sentation (2.8)-(2.9) of the Green operator as a pseudodifferential operator with 
operator-valued symbol, we obtain 

1 

(l + $g[a])wA = + 

= - Xo))(l + H{x, + o(l) 

= - a;o))(l + H{x, Xpo))(p{Xt) + o(l). 



But 

{I + Ho{xo, Xpo))(f>(Xt) 



= p[-] + 



— ) dr' 



' vs) I ST)'"©''©}'"’ 

whence it follows that (b) is also satisfied. 






T 1 + 



□ 



3.1.5. Completion of the proof. Now the assertion of the theorem becomes 
obvious: If the symbol equation is not uniquely solvable at least at one point (x,p), 
p ^ 0, then the operator 1 -h^p[a] is not Fredholm, which shows that the ellipticity 
condition is necessary. On the other hand, if the ellipticity condition is satisfied, 
then one can construct left and right regularizers by solving the corresponding 
symbol equations, thus proving the Fredholm property. The proof is complete. 

□ 

3.2. Ellipticity and the Fredholm property. In this subsection, we es- 
tablish necessary and sufficient conditions for a given morphism 

[OM + ^gig] ®c[c]A . 

( Mb] Dx) 



(3.14) 




530 



V. NAZAIKINSKII AND B. STERNIN 



to have an almost inverse (an inverse modulo compact operators) A~^ G .4 in the 
algebra A. These conditions are called ellipticity conditions. First, we consider el- 
lipticity conditions for morphisms (3.14) with ^g[g] = 0. They are of main interest 
for two reasons: 

• practically interesting problems (Sobolev problems) result only in mor- 
phisms that do not contain Green operators; 

• in this case, one can obtain ellipticity conditions (and an index formula) 
in a finite (algebraic) form. 

Thus, we consider an operator (3.14) without the Green term, i.e., an operator 
of the form 



^ ^ \^b[b] Dx ) 

We seek a (right) almost inverse in the form 

and, multiplying by A on the left, arrive at the system of equations 

[m $5 [6] ij’ 

which must be satisfied modulo compact operators. Let us compute the operator 
on the left-hand side in (3.17). Modulo compact operators, it has the form 

[Dm+^oM 



dM = dMdM, '0 = c*6-hdM*^ 



and the formulas for c, 6, and dx can readily be written out with the use of the 
composition law in the algebra A. In (3.18), dM, dM, and dM are the principal 

symbols of the pseudodifferential operators Dm, Dm, and Dm, respectively. It 
follows from (3.17) and (3.18) that 

dM^M = 1 - 

Thus, a necessary condition for the almost invertibility of the element (3.15) in 
the algebra A is the ellipticity of the pseudodifferential operator Dm‘ Assuming 
that this condition is satisfied, we make some transformations of A that do not 
affect the almost invertibility. 

Namely, we subtract the first row multiplied on the left by ^b[b]D^ from 
the second row. (Here D]^ is an almost inverse of Dm', we freely use this type of 
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notation, which is unlikely to result in confusion.) As a result, modulo compact 
operators we obtain the upper-triangular operator matrix 



(3.19) 



A! 



Dm 

0 Dx 



$c[c] 

$b[6]ZlV$c[c] 



An upper-triangular matrix is almost invertible if and only if so are its diagonal 
entries. Thus, we arrive at the following definition. 



Definition 3.8. An element (3.15) of the algebra A is said to be elliptic if 
the following conditions are satisfied: 

(i) Dm is an elliptic operator on M; 

(ii) the operator 

(3.20) Aa = Dx- $6[6]r>V^o[c] 

(the non- commutative determinant) is an elliptic operator on X. 

Remark 3.9. The second condition possibly deserves an explanation. By the 
composition theorem, the product ^b[l>]D]^^c[c] is a pseudodifferential operator 
on X. Hence so is the non-commutative determinant A^, and we can state the 
ellipticity condition in finite (algebraic) form at least if the symbols occurring in 
Ayi are classical. The symbol of A^i has the form 

(3.21) cj(Ayi) = dx — 5 * dj^ * c, 

where h and c are the symbols of and respectively, and the twisted product 
* in the general form is given by (1.36) and (1.37) and is described in specific 
cases in the composition theorem 1.15 and the subsequent text. In special local 
coordinates, the symbol (3.21) can be represented in the form 

a{AA){x,p) = dx{x,p) + (^) j h{x,p,T)c{x,p,T)d~^{x,Q,p,T)dT. 

If the symbols b{x,p,r) and c{x,p,t) (as well as dx(x,p) and dM{x,t^P^^)) are 
classical, i.e., have homogeneous leading components, then so is the symbol (j(A^), 
and the ellipticity condition acquires a finite form. 



The preceding reasoning implies the following theorem. 

Theorem 3.10. Let A be an elliptic morphism of the form (3.15). Then A is 
Fredholm. 



Let us now state the ellipticity conditions for general morphisms (3.14) con- 
taining a non-zero Green operator in the upper-left corner. We seek an almost 
inverse in the form (3.16); then the first relation in (3.18) remains the same. Thus, 
the ellipticity of Dm is still necessary for the almost invertibility of A in the alge- 
bra. However, the upper-left corner of A is now 

(3.22) All = Dm -\- ^ g[g]^ 
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and the almost invertibility of is not necessary for the almost invertibility of 
A in the algebra so that the reduction to the upper-triangular case simply does 
not work. 



Remark 3.11. The special case in which the morphism (3.22) is still almost 
invertible (one can study this property using the representation 

All = Dm (l + DjJ~^g[g]) = Dm (l + ^g[^M * d]) 

and then analyzing the Green equation with the operator 1 -h ^g[d'^ * g]) was 
considered in [SS96]. In this case, the reduction to a triangular form can be car- 
ried out with Dm replaced by Dm + ^g[9]- particular, the non-commutative 
determinant acquires the form 

(3.23) Aa = Dx — ^b[b]{DM + ^c[c], 

and sufficient ellipticity conditions are that the operators (3.22) and (3.23) must be 
elliptic. By the results of the preceding subsection concerning the Green equation, 
the operator {D -f ^g[g]) ^ again has the form of a pseudodifferential operator 
plus a Green operator so that the non-commutative determinant (3.23) proves to 
be a pseudodifferential operator on X by the composition theorems. 

We consider the general case without the assumption that the operator (3.22) 
is almost invertible. How to state the ellipticity conditions then? To this end, note 
that the almost invertibility of A in the algebra is equivalent to the simultaneous 
almost invertibility of A* A and AA*. Now we note that the almost invertibility of 
A* A implies the almost invertibility of [A* A) n. (The same is also true of AA*.) 
This is a straightforward consequence of the following proposition. 

Proposition 3.12. If 




is a non-negative hounded self-adjoint operator matrix {C = C* > 0) and C is 
almost invertible, then a is almost invertible. 

Proof. The proof is based on the following auxiliary lemma: 

Lemma 3.13. For a hounded operator B = B* >b, the following assertions 
are equivalent: 

(1) B is not Fredholm; 

(2) there exists a sequence of vectors Uj such that \\uj\\ = 1, Uj ^ 0, 

and {uj,Buj) — > 0. 

Indeed, {uj,Buj) = ||v^rtj||, whence we see that the condition {uj,Buj) 0 
is equivalent to Buj 0. Now the implication (2) =4^ (1) is obvious, and to prove 
(1) (2) one can take an orthonormal sequence Uj G R{fj{B)), where 



fj{x) 



1, X< l/j, 
0, x> l/j. 
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Such a sequence always exists, since for non-Fredholm B all projections fj{B) are 
of infinite rank. 

Now it is easy to prove Proposition 3.12. First, it is clear that a is self-adjoint 
and non- negative. If a is not Fredholm, we find a sequence Uj with the properties 
stated in the lemma (for B = a), and it remains to note that the sequence 

Vj =‘(uj,0) 

can be used to prove that C is not Fredholm, since 



(vj,Cvj) = {uj,auj). 



□ 



Thus, the operators A* A and AA* already fall within the framework of the 
special case considered in [SS96] so that we can state the ellipticity conditions for 
A in the following form. 

Definition 3.14. The morphism (3.14) is said to be elliptic if 

(1) the operator Dm is elliptic; 

(2) the operators {A*A)u and (AA*)u are elliptic; 

(3) the non-commutative determinants and are elliptic. 

The above reasoning implies the following theorem. 

Theorem 3.15. If the morphism (3.14) is elliptic, then it is Fredholm. 

Remark 3.16. We have stated the theorem on the Fredholm property for 
elements of the algebra A, i.e., morphisms of order zero acting from the space 
L^(X)0L^(M) into itself. Since the multiplication by pseudodifferential operators 
does not change the structure of the operators in question, the ellipticity conditions 
and the Fredholm property theorem for operators of non-zero order have the same 
form. This remark pertains to the index theorem (see the next subsection) as well. 

Remark 3.17. One can prove that the ellipticity conditions in Definition 3.14 
are actually redundant and it suffices to require the ellipticity of Dm and the 
operators in (2) and (3) for only one of the two operators ^4*^4 and AA*. The 
situation resembles that for Green equations, where it suffices to require only the 
solvability of the equation for the symbol of one of the regularizers, right or left. 

3.3. The index theorem for elliptic morphisms. Here we state a theo- 
rem on the index of morphisms elliptic in the sense of Definition 3.8. 

Theorem 3.18. Let 

V $6 Dx) 

he an elliptic element of the algebra A in the sense of Definition 3.8. Then the 
index of the operator A is given by the formula 

(3.24) ind A = ind Dm + ind A^ , 

where is the non-commutative determinant (3.20). 
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Proof. One has 

1 $c 

l) V 0 Aa 

modulo compact operators. (This identity has actually been used in the proof of 
the ellipticity conditions.) Since the index of a product of operators is equal to the 
sum of indices of the factors and the index of a triangular matrix is equal to the 
sum of indices of its diagonal entries, we arrive at the desired formula (3.24). The 
proof is complete. □ 



4. The Sobolev problem 

Now we apply the results to Sobolev problems. First, we describe general 
Sobolev problems and clarify their relation to elliptic morphisms. 



4.1. Sobolev problems and elliptic morphisms. Let X ^ M be an 

embedding of smooth compact manifolds with codimX = v, 

D: W-^{M,E2) 

an elliptic pseudodifferential operator of order m acting in spaces of sections of 
bundles E\ and E 2 over M, and 

B: H“(M,Ei) H‘-\M,F) 

a pseudodifferential operator of order b acting in spaces of sections of the bundles 
El and E over M. To these data, we assign the problem 

iDu = f mod (M, X, E 2 ), 

^ ^ \i*Bu = ge H^-^-^^^{X,E\x) 

for an unknown function u G H^{M^E). This problem will be called the Sobolev 
problem. We assume that s > & + i//2 so that the restriction i*Bu is well-defined. 
In (4.1), by X, E 2 ) we denote the subspace of E 2 ) formed by 

distributions supported on X. 

It was shown in [Ste76] (see also [SS96]) that problem (4.1) is equivalent to 
the system 



(4.2) 



Du + iuv = /, 
i*Bu = g 



for the unknown functions u G H^(M, E) and 

(4.3) veH^-"^+‘'/^(X,J^{E2)). 

Here JI^{E 2 ) is the bundle of /th-order normal jets of the bundle E 2 on X; the 
elements (4.3) can be represented in an arbitrary special coordinate system (5:, t) 
in the form 

(4.4) u = K}|„|<i, VaGH^-^+‘'/^+'^^{X,E2\^), a = (oi,...,a,). 
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Next, iu is the coboundary operator assigning to each element (4.3), (4.4) the sum 

i 

H*v = ^ 

l«l=l 

consisting of the delta function Sx on X and its derivatives of order < I with 
coefficients Von 

^ {[m — s — v/2] if m — s — vj2 is not an integer, 

1 m — 5 — vj2 — 1 if m — s — z//2 is an integer, 



and s < m — V j2. 

Remark 4.1. If s > m — i^/2, then the space E 2 ) contains no dis- 

tributions supported on X (a “removable singularity”) so that the equation 

Du^f modH^-^{X) 

is equivalent to the equation 

Du^f 

on the entire manifold M for the elliptic operator D. There is no need to equip 
this operator with any boundary conditions on the submanifold X, and so for 
s > m — u/2 the Sobolev problem is reduced to an elliptic operator on M. 



The operator in system (4.2) is given by a morphism of the special form 



(4.5) 






D iu 
i*B 0 



so that one can apply the general theory of elliptic morphisms to A and find the 
ellipticity conditions as well as compute the index of an elliptic Sobolev problem. 

This will be done in the next subsection. Here we discuss the boundary con- 
ditions in problem (4.2) in somewhat more detail. It is of special interest to find 
conditions under which it is possible to state a Sobolev problem using purely dif- 
ferential boundary conditions. The maximal possible order of the operator B is 
given by the formula 



_ j [5 — p/2] if m — s — vj2 is not an integer, 

^mRx — I 

Is — vj2 — 1 if m — s — I//2 is an integer. 

The number of boundary conditions in a well-posed Sobolev problem must 
coincide with the number of the “coboundary conditions” (the dimension of the 
vector V in (4.3)); this follows from the very form of the ellipticity conditions for 
morphisms. Hence Sobolev problems with purely differential boundary conditions 
are possible only for 

(4.6) bmax > I- 

The equality 6max = I is attained for s = m/2. 
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We divide the real line M 3 s into the half-open intervals 



(4.7) 




+ j + 1 



j E Z. 



To each of these intervals there corresponds a certain type of Sobolev problem. 
If s lies in the interval containing the point m/2, then every Sobolev problem with 
differential conditions is equivalent to the Soholev-Dirichlet problem^ in which the 
values of all derivatives of order less than or equal to 



[(m — z/)/2] if (m — i/)/2 is not an integer, 

(m — i/)/2 — 1 if (m — z/)/2 is an integer 



of the unknown function in transversal directions are specified on X. 

As was already mentioned, for 5 > m — v/2 there are no non-trivial Sobolev 
problems (a removable singularity). 

For s lying to the left of the interval containing the point ml2, di well-posed 
Sobolev problem must necessarily contain pseudodifferential boundary conditions. 



4.2. The Fredholm property. Let us write out the conditions under which 
the morphism (4.5) defines a continuous mapping 




For our problem, we have 

(4.9) ag=0, Oc = {r“}|„|<i, at, = B{x,p,t'). 

Here B{x,p,r') is a column consisting of symbols Bj of orders bj, j — , J. 

In particular, S 2 and a 2 in (4.8) are columns^ rather than numbers: 

S2 = {^2}|al</5 ^2 = = 

where J is the number of boundary conditions in problem (4.1), i.e., the height of 
the column a^. 

With regard to this, using the continuity theorems given earlier in this paper, 
we see that the mapping (4.8) is a continuous operator provided that ai = si—m, 

^2 = — m + ^ + |q!| < 0, — Si — ^ — bj > 0. 

Let us now write out the ellipticity condition for the Sobolev problem (4.1) or, 
equivalently, the morphism (4.2). The first ellipticity condition in Definition 3.8 is 
equivalent to the ellipticity of the pseudodifferential operator D. Let us write out 
the second ellipticity condition. One can readily verify that in this case it acquires 
the form of the ellipticity of the pseudodifferential operator 

(4.10) A 



In fact, one should work in the context of Douglis-Nirenberg systems [DN55]. 
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on the manifold X. In particular, this means that the operator (4.10) (which is 
a matrix operator) must be represented by a square matrix. In other words, the 
number J of boundary conditions must be equal to the number of coboundary 
conditions, that is, the number of multi-indices a such that \a\ < 1. 

Thus, the definition of ellipticity of an operator morphism results in the fol- 
lowing notion of ellipticity for the Sobolev problem (see [Ste76]). 

Definition 4.2. The Sobolev problem (4.1) is said to be elliptic if 

(1) the operator D is an elliptic pseudodifferential operator on the manifold 

M; 

(2) the operator (4.10) is an elliptic pseudodifferential operator on the man- 
ifold X. 

The following assertion is a straightforward consequence of the theorem on 
the ellipticity conditions for morphisms. 

Theorem 4.3. If the Sobolev problem (4.1) is elliptic, then it is Fredholm, 
i.e., has a finite- dimensional kernel and a finite- dimensional cokernel. 

4.3. The Sobolev problem and the adjoint problem. Let us now give 
an operator interpretation of the Sobolev problem. The problem 

[Du = f mod /f"-"^(M,X;E 2 ), 

^i*Bu = g 

obviously defines an operator 

(4.11) S: H\M,Ei) X; E 2 )) © F), 

where b is the order of the operator B. 

One can also construct the adjoint of this operator. 

Indeed, if we take into account that X; E 2 ) is just the range of the 

coboundary operator z/*, then the adjoint operator acts in the spaces 

S*: Kex{iu)®W+'>+’'/‘^{M,F) H~%M,Ei), 

and so the adjoint problem has the form 

f Du + Bi^v = / 

\qu = 0 , 

where z* is the operator taking each function u to its normal jet of order I on the 
boundary. One can readily see that the almost inverse of the operator (4.11) has 
the form 

(4.12) S-i = 
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4.4. The index formula. Since the Sobolev problem can be reduced to 
an operator morphism, we obtain the following assertion by using the result of 
Theorem 3.18. 



Theorem 4.4. Let 

{Du = f mod 
^i*Bu = g 

he an elliptic Sobolev problem. Then the following index formula holds: 

ind S — ind D + ind A, 
where A is the pseudodifferential operator 
(4.13) A = -TBD-^iu. 



Remark 4.5. One can readily see that in special coordinates the principal 
symbol of the pseudodifferential operator (4.13) for p 7 ^ 0 is represented by the 
matrix with entries 






T^Bj{x,0,p,T) dr 
D{x,0,p,t) 
k = {ki,...,K), 3 = 



|fc|, \j\ < I- 



Thus, we have reduced the computation of the index of the Sobolev problem 
to the computation of the indices of two pseudodifferential operators on smooth 
compact manifolds without boundary. The index formula for such operators is 
well-known (e.g., see [AS63]). 
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Topological Aspects of Relative Elliptic Theory 

We have already mentioned that relative elliptic theory is an elliptic theory 
for pairs of the form (M, A), where M is a smooth compact manifold and 

A 4 M 

is a closed submanifold. We have seen that relative elliptic theory involves deep re- 
lationships between elliptic pseudodifferential operators on M and A. The aim of 
this section is to study these relationships from the topological viewpoint. Namely, 
we describe a number of functors, related to elliptic operators and their symbols, 
from the category of manifolds with smooth embeddings as morphisms and estab- 
lish Riemann-Roch type theorems comparing these functors. 

5. Preliminaries 

Let K be the category whose objects are smooth compact manifolds M with- 
out boundary and each set Hom(Mi,M 2 ) of morphisms consists of smooth em- 
beddings Ml ^ M 2 . This category will be referred to as the category of (smooth) 
embeddings. If A, M G Ob(/C) and i: X ^ M is an embedding, then there is a 
well-defined mapping z* : TA — > TM^ which is also a proper embedding. (The 
preimage of any compact subset of TM under the mapping is compact.) Using 
the isomorphisms 

T*M - TM, T*A - TA 

(depending on the choice of Riemannian metrics on M and A), we obtain a proper 
embedding T*A — > T*M, which induces a mapping in the A-functor with com- 
pact supports, which will be denoted by 

(5.1) i[,^:K{T*M)-^K{T*X). 

The mapping (5.1) is independent of the choice of the Riemannian metrics, and we 
have a contravariant functor from the category /C into the category 21 of Abelian 
groups; this functor takes each manifold M to the A-group with compact supports 
K(T*M) of the cotangent bundle T*M and each embedding i: X ^ M to the 
morphism (5.1) of the corresponding A-groups, which will naturally be called the 
topological pullback. 

In the subsequent sections, we use analytic tools to construct mappings that 
take each pseudodifferential operator on M to some pseudodifferential operator 
on the submanifold A, find conditions under which elliptic operators are taken to 
elliptic operators, and compare the corresponding functors with the A-functor. 

6. The metric trace of an elliptic operator 

Consider some morphism A 4 M in the category JC. Suppose that the man- 
ifolds M and A are equipped with Riemannian metrics pM and px such that 
i*pM = px- Then there is a natural embedding 
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which admits a twofold description, either as the composition of the mappings 

T*X ~ TX ^ TM ~ T*M 

where the isomorphisms are induced by the Riemannian metric, or with the help 
of the orthogonal expansion 

T*M\^ = N*XeT*X, 

where N*X is the conormal bundle of X in M and the orthogonality is understood 
in the sense of the inner product induced in the fibers of T*M by the Riemannian 
metric. One can readily see that the embedding (6.1) is a bundle monomorphism 

2^:T*X— .T*M|^, 

so that its restriction to TqX (where, recall, TqX is T*X with the zero section 
deleted) can be interpreted as an embedding (denoted by the same letter) 

im:T*X-^T^M 

(or, paissing to the quotients with respect to the action of the group in the 
fibers, as an embedding S*X — > S*M of the cosphere bundles). Hence if 

D : H%M,E) — > 

is an mth-order pseudodifferential operator on M with principal symbol 

a{D):nl,E^nl,F, 

where ttm • T*M — M is the natural projection, then 

(6.2) Ca{D):7r*^{E\x) 

is a well-defined mth-order symbol on TqX. 

Definition 6.1. The pseudodifferential operator with principal symbol (6.2) 
is denoted by Zm(D) and is called the metric trace of the operator D. 

Remark 6.2. Needless to say, the operator is uniquely determined 

only modulo lower-order terms. The term “metric trace” is due to the fact that 
the embedding (6.1) used in the definition of the restriction of the symbol depends 
on the metric. 

Note that if D is an elliptic operator, i.e., the symbol of D is an isomorphism 
on TqM, then the same is true of the restriction of the symbol to TqX. It follows 
that the metric trace of an elliptic operator is elliptic. Next, it is obvious that 
for an appropriate choice of lower-order terms the metric trace commutes with 
direct sums of operators and the metric trace of a continuous operator family is 
a continuous family. Since the set of Riemannian metrics on a given manifold is 
convex (and hence arc- wise connected), we arrive at the following assertion. 
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Proposition 6.3. The metric trace is well-defined as a homomorphism 
(6.3) C • E11(M) Ell(X) 

of Abelian groups of classes of stable homotopy equivalence of elliptic operators 
on M and X. This homomorphism is independent of the choice of Riemannian 
metrics on M and X and is functorial: If 

y'AJ x'^ M 

is a chain of embeddings and iMY — ^mx o ixY, then 

^MY m — '^MX m ^ '^XY m 

Corollary 6.4. The pair Ellm = (Ell, is a contravariant functor from 
JC to the category 21 of Abelian groups. 

Now we can state the almost tautological Riemann-Roch theorem comparing 
the functors K and Ellm- 



Theorem 6.5. Let X ^ M be an embedding of smooth compact manifolds 
without boundary. Then the diagram 

Ell(M) — > Ell(X) 

(6.4) |x 

K{T*M) — > K{T*X), 

Top 

where the vertical arrows are given by the difference construction for the principal 
symbol of an operator, commutes. 

Recall that the difference construction assigns the class [a] G K{T*M) of 
the virtual bundle (tt^E^, tt^F, a) with compact support on T*M to each elliptic 
symbol a: ^ t^F on TqM (e.g., see [LM98, p. 210]). 



Proof. This follows from the commutative diagram 



(6.5) 



Ell(M) Ell(X) 

1 . 1 

Smbl(To*M) Smbl(To*X) 

1 1 

K{T*M) > K{T*X), 



where the upper square commutes by the construction of and the lower square 
commutes since the difference construction is natural. □ 
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7. The pullback of an elliptic operator 

The metric trace is not the unique way of assigning a pseudodifferential op- 
erator on a submanifold to a pseudodifferential operator on a manifold. In this 
section, we describe the pullback related to Sobolev problems. 



7.1. The pullback of a pseudodifferential operator. We have seen that 
an important role in the ellipticity condition and the index formula for elliptic mor- 
phisms is played by the non-commutative determinant, which is a pseudodifferen- 
tial operator on X induced by the main operator Dm together with the boundary 
and coboundary conditions. The simplest version of the non-commutative deter- 
minant arises if one considers the elliptic morphism 



(7.1) 






D 



which corresponds to the Sobolev-Dirichlet problem of order 0 for the operator 
D. The non-commutative determinant is equal to 

(7.2) X = 

where D~^ is the almost inverse of D. Recall that the ellipticity condition for A 
says that both D and the non-commutative determinant (7.2) must be elliptic. If 
this condition holds, then A is Fredholm and 

(7.3) ind = ind D -h ind A. 

Since the boundary and coboundary conditions in the Sobolev-Dirichlet problem 
are standard (i.e., depend only on the embedding z), it follows that the correspon- 
dence D I — A commutes with direct sums of operators. Using this correspondence 
as a model, we define a homomorphism® 

(7.4) zL : PSD<_,(M) ^ PSD(X) 
by setting 

(7.5) o D o Zhc. 

Here, PSD(X) is the Abelian semigroup (with respect to direct sum) of pseu- 
dodifferential operators on X and PSD<_jy C PSD(M) is the sub-semigroup of 
operators of order < — z/ {u = codim A). As follows from the results of the first 
part, the homomorphism (7.4)-(7.5) is well-defined and, moreover, the principal 
symbol of the operator (7.5) can be obtained from the principal symbol of D by 
integrating over the fibers of the conormal bundle. In special local coordinates, 
this formula reads 

(7.6) = (^^^ a{D){x,0,p,T)dT. 



®Which differs from the non-commutative determinant in the Sobolev-Dirichlet problem 
only in sign and the absence of the exponent on D. 
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7.2. The regularized pullback. The pullback thus defined has two disad- 
vantages from the viewpoint of our goals. First, it is well-defined only for operators 
of sufficiently large negative order (depending on the codimension of the subspace) . 
Secondly, we shall see below that the operator (7.5) need not be elliptic if D is 
elliptic. It turns out that both disadvantages can be eliminated by the following 
regularization. Let Am and Ax be the Laplace operators on M and X, respec- 
tively, with respect to the given Riemannian metrics. We set 

(7.7) *L(Z?)(fc) = (l-Ax)'=-‘'/"*L((l-AM)-'=i5). keR. 



(If D acts in sections of vector bundles, then one should take Laplacians with 
coefficients in these bundles.) The operator (7.7) is well-defined for sufficiently 
large /c, namely, for 



(7.8) 



k> 



V -f ord D 
2 



where ord D is the order of the operator D. The values of k satisfying this inequality 
will be referred to as admissible. 



Remark 7.1. We have included the factor (1 — in the definition 

of regularization so as to normalize orders: With this definition, the order of the 
pullback of an operator coincides with the order of the operator itself. This is not 
necessary in principle, but useful, as we shall see in Remark 8.6. 



Theorem 7.2. Let D be an elliptic operator. Then for all sufficiently large k 
the operator i\[D){k) defined in (7.7) is also elliptic and, moreover, its equivalence 
class in Ell(X) is independent of k and is uniquely determined by the equivalence 
class of D in Ell(M). 



Proof. Without loss of generality, we can assume (including sufficiently many 
factors (1 -h A)~^ in D) that D itself has a sufficiently large negative order so that 
its symbol is bounded and integrable at infinity. The formula for the principal 
symbol of the operator i'^{D)(k) on the sphere \p\ = 1 (where \p\ is the natural 
norm on the fibers of T*X) in special coordinates has the form 



2tt J 



(7.9) crii'.iDm) 

(Here = rf + • • • + r^.) We set 

(7.10) Cfc. - [ 

Jm 






(1 + r^)^ 



dr. 



dr 



(l + r2)fc • 



Then the sequence {cku{^ + r^)^) ^ converges to the delta function as k oo, 
and so (with =4 denoting the uniform convergence) 

(7.11) a{D){x,0,p,0) 

(The uniform convergence with respect to (x,p) G S*X can readily be established.) 
This proves the desired assertion. □ 
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Definition 7.3. By 4eg(-^) ^ Ell(X) we denote the class defined in the 
situation of Theorem 7.2 by the operator r^{D){k) for sufficiently large k. 

Remark 7.4. One can show that r^{D){z) is a meromorphic operator- valued 
function of z. It is of interest to study the residues of this function, but we do not 
touch upon this topic in the present paper. 

7.3. The Riemann-Roch theorem for the regularized pullback. Now 

we can establish a Riemann-Roch theorem comparing the functors K and Elfieg = 

(Ell, ••eg)- 

Theorem 7.5. Let X ^ M be an embedding of smooth compact manifolds 
without boundary. Then the diagram 

Ell(M) > Ell(X) 

(7.12) xj |x 

K{T*M) — > K{T*X), 

hop 

where the vertical arrows are given by the difference construction for the principal 
symbol of an operator, commutes. 

Proof. It follows from formula (7.11) that 4eg == ^m- remains to apply 
Theorem 6.5. □ 



8. A finitely regularized pullback 

The definition of the regularized pullback has the following peculiarity: One 
does not simply choose a k such that the integral in the definition of the pullback 
converges (an admissible k); instead, one must take an arbitrary sufficiently large 
/c. It is only under this condition that Theorem 7.2 guarantees that a given elliptic 
operator D produces an elliptic operator, and Theorem 7.5 compares the two 
functors. The following natural question arises: Is it possible (say, for operators of 
given order) to use some given finite regularization, i.e., choose an admissible k 
once and for all? Then we would have the additional advantage that the operation 
zj.gg would be defined for individual operators rather than only for their equivalence 
classes in Ell(M). 

The following example shows that the answer is “no” . Later in this paper, we 
shall indicate operator classes for which one can successfully use a finite regular- 
ization. 

8.1. A counterexample. In the forthcoming argument, we analyze the be- 
havior of symbols over a given point x ^ X. One can readily obtain specific 
counterexamples by considering, say, operators with constant coefficients on the 
tori ^ T^. 
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Thus, let 0 be the m-dimensional space with coordinates (p, r), 

p G E^, T G E^, We shall study the pullback (7.9) of a symbol a(p, r) of arbitrary 
given order r for a given admissible k. Without loss of generality, we can assume 
that A:=0 (including the corresponding non-zero factor in a) and r < —u. For 
simplicity, we work with scalar symbols, which suffices for constructing a coun- 
terexample. 

Proposition 8.1. There exists an elliptic symbol a{p,r) of order r such that 
z^(a) = 1 and the pullback ia{o) is homotopic in the class of elliptic symbols to an 
arbitrarily chosen elliptic symbol b{p) on the sphere C E’^. 



Remark 8.2. Prior to proving the proposition, note that it also implies the 
existence of an elliptic symbol whose pullback under a finite regularization is not 
elliptic. Indeed, take a symbol b non- homotopic to unity and for the corresponding 
symbol a consider the family (1 + r^)~"a(p, r). For (T = 0, the pullback of 

this symbol is homotopic to b in the class of elliptic symbols, and as a ^ oc, the 
pullback becomes homotopic to the metric trace, i.e., to unity. Thus, somewhere 
in between the pullback is necessarily non-elliptic. 

However, the existence of an elliptic symbol with non-elliptic pullback can 
be shown in a much simpler way, by using a second-order differential operator 
as an example. Namely, let D be the square of the “distorted” Cauchy-Riemann 
operator. 






d , d 



2 



where A is a non- zero real constant to be chosen later. Then cr{D) = — (p + ^Ar)^, 
and on the sphere {|p| = 1}, i.e., for p = ±1, we have 






\27ry Poo (1 + ^ i-oo (1 + 27T y_oo (1 + 

[c/cl (^fc— 1,1 Cfcl)'^ ] ■ 



(The term of the first order in r disappears after integration, since the integrand 
is odd.) For given k, we obtain a pullback with zero principal symbol by setting 



A = 



Ckl 

Ck-1,1 — Ckl 



Proof of the proposition. We represent the sphere 



as the union 

gm-l ^ y 



of the subsets 



= {(p,r) e 



p = bP} 
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homeomorphic to the disc {|r| < 1}. All these subsets intersect in the common 
sphere 

S‘'-^ = dD^ = {p = 0, |rl = 1}. 

The formula for the symbol of the pullback on the sphere acquires the form 

(8.1) i[{a){uj)= [ a{p,r)fi{r)dr, 

where /i(r) is a continuous function in the disk {|r| < 1} that is strictly positive 
outside the boundary of the disk. (This function, which depends on the order r of 
the symbol a, is easy to compute, but the specific expression will not be needed 
here.) 

Let 6: > 0 be a small positive number. We set 

Duj,e = -Do. n {e < |t| < 1 - e}, 

Dt>,e = n {n > 0}, 

DZ,e = n {n < 0}. 

We define a continuous symbol a{p,r) on the sphere by the following con- 

ditions, which determine its behavior on each of the sets 



(1) 


a is elliptic (i.e. 


, everywhere 


non-zero on the sphere) and nowhere exceeds 




1 in modulus; 










(2) 


a = 1 on dD^] 










(3) 


arg a = arg b{uj 


)in 


for 


UJl > 


-e/2- 


(4) 


a = arg b{iv) ^ 


>0; 




(5) 


|a| < e in £>+„ 


for 


LJl < —s^ 


/2; 




(6) 


arg a = arg b{u; 


)in 


for 


CJi < 


e/2; 


(7) 


a = in Z)’ 


; J for 


o 

VI 




(8) 


|o| < £ in 


for 


ui > e/2 







The existence of a symbol satisfying these conditions is clear, since the sets ooi > 
—e, uoi < e, etc. are contractible. Condition (2) guarantees that “ 1- Next, 

for sufficiently small ^ > 0 the main contribution to the integral (8.1) is from the 
domains ^ for cui > —s and D~ ^ for uj\ < e. It follows that the integral is 
non- zero and d.vgi\a{Lo) arg6(o;) ais £ ^ 0. Hence, for sufficiently small ^ > 0 

the symbols and h{(jj) are homotopic in the class of elliptic symbols, as 

desired. □ 

8.2. The pullback for linear principal symbols. However, there are two 
cases in which the pullback of an elliptic operator is elliptic even for a finite 
regularization (7.7) (i.e., for any admissible k). These cases are considered in this 
and the next subsection. 

Definition 8.3. Let M be a Riemannian manifold. We say that D is a pseu- 
dodifferential operators with linear principal symbol on M if for each point y ^ M 
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the restriction of the principal symbol (j{D) to the unit sphere S*M cT*M coin- 
cides with the restriction to the same sphere of some homogeneous linear function 
on T;M. 

Remark 8.4. This notion of an operator with linear principal symbol depends 
on the choice of unit spheres, i.e., of the Riemannian metric, with the exception of 
the operators whose principal symbol is linear on the entire T*M (say, first-order 
differential operators). The reason for introducing this class of operators is as fol- 
lows; This class, in contrast with the class of first-order differential operators, is 
preserved by pullbacks regardless of the normalization. (However, see Remark 8.6 
below.) Differential operators are undoubtedly of main interest in specific exam- 
ples. 



Theorem 8.5. Let X ^ M he an embedding of Riemannian manifolds and 
let D he an elliptic pseudodifferential operator with linear principal symbol on M. 
Then for each admissible k the pullback r^{D){k) is an elliptic pseudodifferential 
operator with linear principal symbol on X homotopic in the class of elliptic opera- 
tors to the metric trace i"^{D) {which is also an elliptic pseudodifferential operator 
with linear principal symbol on X). 

Proof. In special coordinates, the principal symbol a{D) has the form 

(8.2) <^{D)= {A{x,t)p + B{x,t)r){\pf + 
where a = ^{oidD — 1), 

A{x,t) = {Ai{x,t ), . . .,Am{xA)), B{x,f) = (Ri(x,t), . . . ,5^(x,t)) 

are some sets of matrices, Ap = similarly for Br. On the sphere 

{IpI = 1}, the principal symbols of the metric trace and the regularized pullback 
of D (for admissible values of the regularization parameter k) have the form 

(8.3) a{i*^{D))=il,<T{D)=A{x,0)p, 

(8.4) a{i}^{D){k)) = (Tj Ck-a,^A{x,0)p. 

(Here, just as in the example in Remark 8.2, the term with Br disappears, since 
the integrand is odd.) The expressions (8.3) and (8.4) coincide up to a non-zero 
factor; the fact that the metric trace is elliptic has already been discussed. The 
assertion of the theorem now readily follows. □ 

Remark 8.6. One can readily see that with our normalizations (see Re- 
mark 7.1) the pullback of a first-order differential operator is (up to lower-order 
terms) again a first-order differential operator. 

By abuse of notation, we denote the pullback of an elliptic operator D with 
linear principal symbol by ia{D), omitting the regularization parameter k. This is 
justified, since by the theorem the pullback defines the same element in Ell(X) for 
any admissible k. The above theorem implies the following important assertion. 
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which can be treated as the Riemann-Roch theorem for operators with linear 
principal symbol. 

Corollary 8.7. If D is an elliptic operator with linear principal symbol, then 
(8.5) = 4op^(Z)) e K{T*X), 

where the square brackets stand for the difference construction for the principal 
symbol. 



8.3. Pullbacks and exterior tensor products. Another case in which the 
ellipticity of the pullback is guaranteed is the case in which the elliptic operator 
in question has the structure of an exterior tensor product in a neighborhood of 
X. The exterior tensor product, which takes two elliptic operators Ai and A 2 on 
two manifolds to an elliptic operator A\ffA 2 on the product of these manifolds (or 
on the bundle, where one of the manifolds is the base and the other is the fiber) 
plays a fundamental role in elliptic theory. We shall describe this construction in 

the situation of an embedding X ^ M, which is of interest to us. We identify 
a tubular neighborhood U o^ X with a neighborhood of the zero section in the 
normal bundle NX via the exponential mapping. 

Let 

(8.6) Di : C^(X, £’ 1 ) — ^ C^{X, Fi) 

be an elliptic differential operator^ of some order m on X. Next, let 

(8.7) £ 2 : C^{N,X,E2,) — > C^{N^X,F2.) 

be an elliptic differential operator of the same order m in the fiber Nx smoothly 
depending on the parameter x G A and defined at least in U . Here E 2 x and F 2 x 
are the restrictions to Nx of some vector bundles £2 and £2 over U. We assume 
that all bundles in question are Hermitian. The lifts of £1 and F\ to U via the 
natural projection of the normal bundle on the base X will be denoted by the 
same letters. 



Definition 8.8. The exterior tensor product of the operator Di by the op- 
erator family £2 (or, for brevity, of the operators Di and £ 2 ) is the differential 
operator 



(8.8) £i#£2: C""(£,£i^£2 0£i0£2) — >C°"(£,£i^£2 0£i^£2) 



in U with principal symbol 



(8.9) 



<t{D^#D2) 



<j(£i) (g) 0 Ct(£2)* \ 

0 <^(^ 2 ) — <j(£i)* 0 fy*F2/ 



^We work only with differential operators to avoid considering non-smooth symbols. The 
results remain valid for pseudodifferential operators if for operators with non-smooth symbols 
one uses definitions in the spirit of [H6r85a, Chap. 20]. 
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where tt: TqM — ^ M is the natural projection. (In formula (8.9), the symbol 
cr{Di) is lifted from T*X to T*{NX) with the help of the projection 

T%NX) - T{NX) — >TX ^ T*X, 

where the isomorphisms are induced by the Hermit ian metric.) 

Theorem 8.9. Let D be an mth- order elliptic operator on M coinciding on 
X with the exterior tensor product (8.8).* 

D\^ = {D^#D2)\^. 

Then for any admissible k the pullback of D on X is elliptic, and 

(8.10) i{D){k) = 4(D) G Ell(X). 

Thus, the pullback is independent of the regularization parameter k up to 
homotopy equivalence, and so it will be denoted by ^^(D) in what follows. 

The following theorem can be viewed as a ‘‘Riemann-Roch theorem for exterior 
tensor products” . 

Theorem 8.10. Under the assumptions of the preceding theorem, the formula 

(8.11) \i[m = [Di] {[Eax] - [F2 x]) € K{T*X) 

holds, where [A] is the difference construction for the principal symbol of an oper- 
ator A, [E] is the element generated by a bundle E in the K -group, and E 2 X cind 
E 2 X the restrictions of the bundles E 2 and E 2 to X. 



Proof of theorems 8.9 and 8.10. Let us compute the symbols of the met- 
ric trace and the pullback of D on S*X. We have 



( 8 . 12 ) 

On the other hand, 

(8.13) a(i'-,{D^#D2)){k) = 



<y{Di){p) ® 

0 



0 

-(t{DI){p) ® 1 



'!T*F2X 






Itt^Fix ^ ^ 
-CkuCr{Dl){p) 0 1 



where 

/■ ct(D2)(t) dT 

J (l + r2)fc • 

The symbol (8.13) is obviously elliptic (its matrix is the exterior tensor product 
of the elliptic symbol Cki 2 cr{Di){p) by the matrix V) and homotopic in the class of 
elliptic symbols to the matrix (8.12) via the homotopy 



/'[{l-t)ck,j + t]a{Di){p)®lT,.E2x (1 - ® 1^ A 

t (1 - l)l7r*£ix ® ~[{'i--t)Ck„+i\a{Dl){p)®l^-F2x) ' 

which proves the assertion of the first theorem. To prove the second theorem, one 
explicitly computes the element corresponding to the symbol (8.12) in the R"-group 
regarding the fact that [D*] = —[Di]. The proof is complete. □ 
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9. The pullback of geometric operators 

In this section, we compute the pullbacks of the Hirzebruch, Euler, Todd 
(Cauchy-Riemann), and Dirac operators. All these operators are linear and can 
be represented as exterior tensor products in neighborhoods of submanifolds; thus, 
they are covered by the assumptions of both Subsections 8.2 and 8.3. Hence their 
pullbacks are elliptic for any admissible value of the regularization parameter, and 
the corresponding element of the A-group can be computed according to The- 
orem 8.10. Geometric operators are a special case of group operators (operators 
associated with a G-structure of a manifold) . We briefly recall this well-known con- 
struction mainly to introduce the notation. Details can be found, say, in [Pal65]. 

9.1. Group operators. Let G be a compact Lie group and M a compact 
manifold without boundary. 

Definition 9.1. One says that M is equipped with a G-structure if an 
orientation-preserving isomorphism 

(9.1) PxVc:^TM 

G 

is given, where V is an oriented real G-module of dimension n = dimM and 
P — M is a principal G-bundle. (In other words, TM is equipped with the 
structure of a vector bundle with structure group G associated with the principal 
bundle P.) 

Let M be a manifold with G-structure (9.1), and let E and F be finite- 
dimension complex G-modules. Next, let (with 5(E*) the unit sphere in V*) 

(9.2) a : S{V*) — > Hom(P, F) 

be a G-equivariant {cr{g^) = go‘{09~^) mapping such that a(^) is invertible for all 
^ G ^(H*). The mapping (9.2) determines an elliptic symbol 

(9.3) ap:7T*E — > 7t*P 
on the cosphere bundle S*M, where 

E = P X E, F ^ P X F, 

G G 

and 7 t: ^ M is the natural projection. 

Definition 9.2. The operator D on M with symbol cr{D) = dp is called the 
group operator {G- operator) on M associated with the principal bundle P and the 
mapping a. The method used to construct D from these data is referred to as the 
universal construction. 

We also consider group operators with coefficients in an arbitrary vector bun- 
dle H. The symbol of such an operator is obtained as the tensor product of the 
symbol of a group operator by the identity automorphism Ip. 
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9.2. The Euler and Hirzebruch operators. Let y be a real vector space 
of dimension dim V — n equipped with an inner product. We treat as an oriented 
50 (n)- module. (To this end, it suffices to choose an orthonormal basis 
in V.) By 

n 

AcT) = 0A'T)®C 

J=0 

we denote the complexified direct sum of exterior powers of V . This is also an 
50(n)-module with respect to the action defined on decomposable vectors by the 
natural formula 

c/(/i A---A/s) =*' 5 (/i)A---A 5 {/s), geSO{n), fjEV. 

(The action is extended to the entire A(^(V) by linearity.) 

We define an 50(n)-equivariant mapping 

(9.4) a: 5(W) — Hom(Ae(V), Ac(V^)) 

by the formula 

(9.5) = + 

where is the operator of interior multiplication by the vector i.e., the substitu- 
tion of ^ as the first argument into a form (e.g., see [Stb64, Chap. 1, Eq. (4.11)]). 
(We have used the identification V* V.) 

An oriented Riemannian manifold M of dimension n can always be equipped 
with an 50(n)-structure. (The structure group of the tangent bundle is reduced 
to SO{n).) The universal construction applied to the map (9.4)-(9.5) gives the 
elliptic operator 

(9.6) d^6: r(Ac(T*M)) — ^ L(Ac(T*M)), 
where 

n 

(9.7) Ac(T-M) = 0 AT*M C 

i=o 

is the complexified bundle of exterior forms of all degrees on M and S is the adjoint 
of the exterior differentiation operator with respect to the Riemannian metric. The 
Euler and Hirzebruch operators are obtained from the operator (9.6) by restriction 
to some subspaces (or, equivalently, by restriction of the symbol (9.4)-(9.5) to some 
submodules of A(^(E)). 

9.2.1. The Hirzebruch operator. Suppose that the module V (and accordingly 
the manifold M) is even-dimensional: n = 2N. Then Aq{V) has the involution 

(9.8) Q = Ac(V — » Ac(V, 

which commutes with the group action. Here * is the Hodge operator given by the 
formula (e.g., see [Rha55, Sec. 24]) 

(9.9) *(g/3i A • • • A £/3j = A ... A 
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where j3 = {/^i, . . . , /? 2 iv} is a permutation of the numbers 1, . . . , 2N ^ is the 
parity of /3, and stands for the operator acting by multiplication by the 

number (where i is the imaginary unit) on the component A^(y). Thus, 

we have the direct sum of modules 

(9.10) Ac(y)-A+(y)0A_(l"), 

where the A±(F) are the eigenspaces of a corresponding to the eigenvalues ±1. 
The homomorphism (9.4) anti-commutes with a for any 

a(<J)o! + acr(^) = 0. 

Hence the restriction 

(9.11) A+(y)-^A_(V) 

is well-defined. An application of the universal construction to aj-i gives the oper- 
ator 

(9.12) HM^d + S: T(A+(T*M)) — > T(A_(T*M)), 
which is called the Hirzebruch operator on M. Here 

A±(T*M) c Ac(T*M) 

are the bundles on M associated with the modules A±(f/). The principal symbol 
of the Hirzebruch operator will be denoted by ct{'Hm)- The Hirzebruch operator 
with coefficients in a bundle E over M will be denoted by Hm 0 1e; its principal 
symbol is 0 17 f*e- 

Now let AT ^ M be an oriented Riemannian submanifold of even dimen- 
sion m = 21. On X we have a direct sum decomposition of the cotangent bundle: 

(9.13) TM\x =TX^NX. 

Accordingly, one has 

(9.14) A+(TM|x) = (A+(TA:) ® A+{NX)) © (A_(TZ) ® A-{NX)), 

(9.15) A_(TMx) = (A_(rX)®A+(ATX)) ® (A+(TX) ® A_(1VX)). 

Moreover, a straightforward computation shows that, according to (9.14)-(9.15), 
the Hirzebruch operator can be represented on X as the exterior tensor product 

(9.16) nM\x = inxmNx)\j, 
of the Hirzebruch operator on X by the family 

'Hnx = {Hx^xjxex 

of Hirzebruch operators in the fibers of the normal bundle NX. By applying The- 
orem 8.10, we arrive at the following assertion. 

Theorem 9.3. The pullback on X of the Hirzebruch operator on M satisfies 
the following relation in K{T*X): 

(9.17) [fL(WM)] = [Hx] ([A+(XX)] - [A_(XX)1) e K{T*X). 
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Remark 9.4. 1. By Theorem 8.9, the same relation naturally holds for the 
metric trace of the Hirzebruch operator. 

2. Let E be an arbitrary vector bundle over M. Since 

ij~ix#'HNx) ^ 1e), 

where the second factor in the exterior tensor product is the family given by the 
formula 

'Hnx 1e "= {'Hn^x ^ '^e\n^x}^^x^ 

we arrive at the following formula for the pullback of the Hirzebruch operator with 
coefficients in E: 

(9.18) ^ Ie)] = [Hx] ([A+(iVX) ^ E] - [A_(iVX) ^ E]) e K{T^X). 

9.2.2. The Euler operator. Now we do not assume that the module V and the 
manifold M are even-dimensional (even though the results are actually of interest 
only for the even-dimensional case) and replace (9.10) by the decomposition 

(9.19) Ac(R) = Aodd(R) 0 Aeven(R), 

where Aodd(^) and Aeven(^) are the subspaces of complex- valued forms of odd 
and even degrees, respectively. 

The restriction of the symbol (9.4)-(9.5) to Aeven(^) acts in the spaces 

(9.20) as = ' Aeven(R) — ^ Aodd(R), 

and the universal construction takes as to the operator 

(9.21) SM=d + S: r(Aeven(T*M)) ^r(Aodd(T*M)), 

which is called the Euler operator on M. Its principal symbol will be denoted by 
a{SM)- The Euler operator with coefficients in a vector bundle E over M will be 
denoted by 8 m 0 1e 5 hs principal symbol is a {Em) 0 Itt* e- 

Now let X ^ M be an oriented Riemannian manifold of dimension m. The 
decomposition (9.13) induces the decompositions 

(9.22) Aeven(TMU) = (Aeven(TX) ® Aeven(XX)) © {Kaa{TX) ® Aodd(XX)), 

(9.23) Aodd(TMx) = (A„dd(TX) ® © (Aeven(TX) ® Aodd(A^^))- 

A straightforward computation shows that, in accordance with (9.22)-(9.23), the 
Euler operator can be represented on X by the exterior tensor product 

(9.24) — {^xif^8Nx)\x 
of the Euler operator on X by the family 

^Nx — {8N^x}xex 

of Euler operators in the fibers of the normal bundle NX. Applying Theorem 8.10, 
we obtain the following assertion. 
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Theorem 9.5. The pullback on X of the Euler operator on M satisfies the 
following relation in the K- group K{T*X): 

(9.25) \i'a{SM)] = [Sx] {[Ae.en{NX)] - [Aodd(iVX)]) G K(T*X). 

Remark 9.6. 1. By Theorem 8.9, the same relation holds for the metric trace 
of the Euler operator. 

2. Let E be an arbitrary vector bundle over M. Arguing as for the Hirzebruch 
operator, we obtain the following formula for the pullback of the Euler operator 
with coefficients in E\ 

(9.26) [zL(^m ^ 1e)] - [Sx] ([Aeven(iVX) ® E] - [Aodd(iVX) ^ E]) G K(T*X). 

9.3. The Todd and Dirac operators. Quite similar considerations give 
completely analogous results for the pullbacks of the Todd and Dirac operators. 
Hence, we only give the statements of the corresponding theorems. 

9.3.1. The Todd {Cauchy-Riemann) operator. Let M be a complex-analytic 

manifold and X ^ M be a complex- analytic submanifold. Then the normal bundle 
NX is a complex vector bundle, and we write 

Aodd(A^X) = 0 A^{NX), Aeven(A^^)= 0 A^{NX). 

j=l mod 2 j=0 mod 2 

(Complexification is not needed.) 

Theorem 9.7. Let Tm and Tx be the Todd operators on M and X, respec- 
tively, and let E be an arbitrary complex vector bundle over M . Then the following 
relation holds in the group K{T*X): 

(9.27) [^UTm 0 1 e )] = [Tx] ([Aeven(iVX) 0 E;] - [AoMNX) 0 E]) G A(T*X). 

9.3.2. The Dirac operator. Let M be an oriented Riemannian manifold of di- 
mension 2N with a spinor structure and let X be an oriented Riemannian subman- 
ifold of dimension 2n also equipped with a spinor structure which is compatible 
with that on M. 

Theorem 9.8. Let 1 />m and lf>x the Dirac operators on M and X, respec- 
tively, and let E be an arbitrary complex vector bundle over M . Then the following 
relation holds in the group K{T*X): 

(9.28) ® 1b)] = [V>x] {[^+{NX) ® £;] - [A_(ATX) ® E]) G K{T*X), 

where the A±(E) are the half-spin representations of the group Spin(2(X — n)) 
corresponding to a Spin(2(A’ — n)) -module V. 
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Appendix. Fourier Integral Operators 

Here we recall some well-known material from the theory of Fourier integral 
operators and simultaneously introduce the notation used in the main body of the 
article. For details, the reader is referred to Hormander’s book [H6r85b] and also 
to [MSS90]. Our notation is close to that used in the latter book. We do not give 
any precise statement of theorems from these sources, just because the Fourier 
integral operators emerging in the theory of Sobolev problems are a special case 
not covered by the general theorems. Accordingly, the material given here serves 
only as a motivation for our reasoning. Precise statements of theorems for our 
special case are given at appropriate places in the main text. 



A.l. Homogeneous Lagrangian manifolds. Let X and Y be mani- 
folds of dimensions m = dim A and n = dimF. The cotangent bundles T*A and 
T*Y bear the canonical 2-forms (symplectic forms) Ux and cOy, whose expressions 
in canonical local coordinates {x^p) and {y,q) on T*X and T*F, respectively, are 

m n 

u\ = ^ dpj A dxj = dp A dx^ cjy = ^ dqj A dyj = dq A dy. 

The group of positive numbers naturally acts on (and T*F) by multipli- 
cation in the fibers. Let us equip the product T*X x T*Y = T*{X x Y) with the 
canonical form equal to the difference of the canonical forms on the factors: 



2 ^ 2 
(jJXY — 



■ OUy. 



A submanifold 

L^T^{X X Y) 

is called a homogeneous Lagrangian manifold if the following conditions hold: 

Lagrangian property: Yc^xy — ^5 
maximum dimension: dim L = m + n; 
homogeneity: L is M+-invariant, and 

L c To*(X X F) = T*(A X F) \ 0, 
where 0 is the zero section of T*(A x F). 

The following additional condition is often imposed on a homogeneous La- 
grangian manifold L. 



Condition A.l. The manifold L is closed in Tq*(X x F) and is contained in 

T^X X To*F. 

In particular, it is used in general boundedness and composition theorems for 
Fourier integral operators (see below). However, the Lagrangian manifolds corre- 
sponding to most of the operators considered in this paper (including boundary, 
coboundary, and Green operators) do not satisfy this condition. That is why they 
need special treatment and display a variety of new effects. 
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A. 2. Local description of homogeneous Lagrangian manifolds. Let L 

be a homogeneous Lagrangian manifold in T*(X x Y). By the lemma on local 
coordinates [Arn67], the manifold L can be covered by E^-invariant coordinate 
charts such that the coordinates in each of the charts are of the form {xi ,pj,yj, Qj ) , 
where {x,p) and (y^q) are canonical local coordinates on T*X and T*Y^ respec- 
tively, I C J C {l,...,n}, 7 = \ I, J = \ J, 

xj — etc. These coordinates are referred to as canonical coordinates^ and 

the corresponding canonical chart on L will be denoted by Uij. Thus, we have the 
coordinate map 

i^ij = {^uPj^yj^qrj)'’ Uij — > Vij c 



In the chart Ujj, the manifold L is specified by a uniquely determined generating 
function {action) Su{xi^pj,yj,qj) defined in Vjj and homogeneous of degree 
one^ in (pj, qj) such that the equations of L read 



(A.l) 



Pi 



ds 



ij 



dxj 



dSij 
dpj ’ 



qj = - 



dSjj 

dyj ’ 






dSij 



(The signs in these equations are due to the fact that uj'x euiiu UUy 
opposite signs in oj\y.) 



dqj ■ 
and cov occur with 



A. 3. Composition of homogeneous Lagrangian manifolds. Let Li C 

r*(Mi X M2) and L2 C T*(M2 x M3) be homogeneous Lagrangian manifolds. 
We can view these manifolds as relations in T*Mi x T*M2 and T*M2 x 
respectively (that is why they are called “homogeneous canonical relations” in 
Hormander’s writings), and then we can define the composition L\ o L2 as the 
product of these relations: 



(A.2) Li o L2 = 

{{u,v) G T*Mi X r*Ms I G r*M2! {u,w) G Li, {w,v) G L2}. 

If the composition (A.2) is clean (i.e., L\ x L2 intersects T*Mi x At^M2 ^ 
where At* M2 is the diagonal in T* M2 x T* M2, in a manifold L with tangent plane 
everywhere equal to the intersection of tangent planes of intersecting manifolds), 
proper (i.e., the projection L — > T*(Mi x M3) is proper), and connected (i.e., the 
set -y) of points of L projected to the same point (u, u) G Li x L2 is connected), 
then the composition L = L10L2 is also a homogeneous Lagrangian manifold. The 
dimension e = dim L(^u,v) fiber of the projection L — > L is called the excess 

of the clean intersection. 



A. 4. Definition of Fourier integral operators. Let L be a homogeneous 
Lagrangian manifold in T*{X x Y). Suppose that L is equipped with a quantized 
measure fi (e.g., see [NOSS81] and references therein). Then Maslov’s canonical 
operator /C = takes asymptotically homogeneous functions on L to 



‘Since L is homogeneous, it follows that / or J is not empty. 
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distributions on X x F is well-defined (e.g., see [NOSS81] and the appendix 
in [MSS90]; for the original (small parameter) canonical operator, see [Mas72]). 

A Fourier integral operator 

5: C^{Y) —^V'{X) 

associated with L in T*{X x Y) can be defined as follows. One takes a smooth 
asymptotically homogeneous amplitude function a on L and takes ^ to be the 
operator with the (distributional) Schwartz kernel JCa. The local description can 
be obtained in the following manner. Let us cover L with canonical charts. Consider 
some canonical chart Uij. Let a{xi^pj^yj,qj) be a smooth function supported in 
Vij and satisfying the estimates 



(A.3) 



yj, qj) 

dx^dpjdy^dqj 



< + \pj\ F \(tj\Y 

\^\ + l/^l + I 7 I + 1^1 = 0, 1, 2, . . . 



for some r e M. (In practice, one mostly deals with functions a{xi,pj,yj,qj) 
asymptotically homogeneous in {pj,Qj)-) The local Fourier integral operator with 
amplitude a associated with the Lagrangian manifold L in the chart Uu is defined 
as the integral operator $(L,a) with Schwartz kernel 



(A.4) K{x,y)=X, 

l{m-n)l2 









where a — ay/jlj and /i/ is the density of the measure y in the coordinates of the 
chart Uij. (Here X is the Fourier transform and X the inverse Fourier transform. 
Products like xjpi are defined as xipi — ^j'Pr) $(L, a) acts as follows: 



(A.5) 



[$(L,a)i/'](a;) = K{x,y)'ip{y) dy. 



Global Fourier integral operators can be defined as sums of local Fourier integral 
operators in the charts, with usual precautions taken to ensure all sums to be 
locally finite etc. (This is, of course, not needed if L/R_^ is compact and hence can 
be covered by finitely many canonical charts.) The stationary phase method allows 
one to compare Fourier integral operators aissociated with charts that have non- 
empty intersections, and for the case of asymptotically homogeneous amplitudes 
one can define the notion of principal symbol of a Fourier integral operator, which 
is globally well-defined as a function on L. If a is asymptotically homogeneous, 
then the leading part of a is called the principal symbol of the Fourier integral 
operator. However, we do not dwell on this, since in the main text we only deal 
with local expressions like (A.4). 
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A. 5. PseudodifFerential operators as Fourier integral operators. An 

important example of Fourier integral operators occurs if one takes the diagonal 

(A.6) Lx = {{x,p,x,p) I (x,p) e T^X} cT*{Xx X) 

as the homogeneous Lagrangian manifold. The canonical coordinates on Lx can 
always be taken in the form (x,p') (where primes are used on the variables per- 
taining to the second factor T*X in the product T*X x T*X), the generating 
function is S = p'x^ and one has 

[^{Lx,a)ip]{x) = (^j jj e‘P'^^~^'^a{x,p')dp'dx. 

We see that ^{Lx,cl) is just the pseudodifferential operator with symbol a{x,p). 

Fourier integral operators possess a variety of properties, the main of which are 
boundedness properties, composition formulas, and the passage to the L^-adjoint 
operator. Let us recall these properties. 

A.6. Boundedness theorems. Boundedness theorems [H6r85b, Theorem 
25.3.8] claim that Fourier integral operators associated with a Lagrangian manifold 

L At*(X X Y) 

extend to bounded operators between Sobolev spaces H^{Y) and H\X) provided 
that L satisfies condition A.l; the lower and upper bounds on the order s — I 
depend on the order of the amplitude as well as on the co-rank of the lift of the 
canonical form (or, which is the same, ujy) to L. 

A. 7. Composition theorems. Composition theorems for Fourier integral 
operators proved in [H6r85b, Theorem 25.2.3] establish that under mild con- 
ditions the product of two Fourier integral operators is again a Fourier integral 
operator. Namely, let Li C T*(Mi x M2) and L2 C T*(M2 x M3) be Lagrangian 
manifolds and let be Fourier integral operators associated with L^, i — 1,2, 
respectively. Next, suppose that the composition L = L\ o L 2 (see (A. 2)) is clean 
and that both Li and L2 satisfy condition A.l. Then the product ^1^2 is a Fourier 
integral operator associated with the Lagrangian manifold L. Moreover, if is the 
principal symbol of (defined on the Lagrangian manifold Li), i = 1,2, then the 
principal symbol a{u,v) of $1^2 at a point (u,v) e L is equal to the integral of 
the direct product ai x a2 = ai{u,w)a 2 {w,v) over the fiber L(^u,v) of the bundle 
L — > L (see Subsection A. 3). A special case of this theorem occurs if one of the 
manifolds Li and L 2 is the diagonal (or the identity relation) I. Since I o L = L 
(and likewise L o 7 = L) for any Lagrangian manifold for which the composition 
is well-defined, we see that the product of a Fourier integral operator associated 
with a Lagrangian manifold L by a pseudodifferential operator is a Fourier inte- 
gral operator associated with the same manifold L. Moreover, the excess of such 
compositions is always zero, and so the principal symbol of the product is just the 
product of the principal symbols of the factors (taken at appropriate points). 
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A. 8. adjoints of Fourier integral operators. Let $ be a Fourier in- 
tegral operator associated with a homogeneous Lagrangian manifold 

L C T*(Mi X M 2 ). 

Then the L^-adjoint of the operator $ is also a Fourier integral operator. It is 
associated with the Lagrangian manifold 

(A.7) = {(u,u) I G T*Mi, u G T*M 2 , (n,u) G L} c T*(M 2 x Mi) 

obtained from L by transposing the factors. 

A. 9. Fourier integral operators on sections of vector bundles. All 

preceding considerations pertain to the case of Fourier integral operators acting in 
function spaces, but the generalization to the case of operators acting in spaces of 
sections of vector bundles is straightforward. The (principal) symbol of a Fourier 
integral operators acting between spaces of sections of vector bundles is a morphism 
between the lifts of these bundles to the Lagrangian manifold. 
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